v.0.0.r3.g7736133-1 - "No space left on device" when pkg directory is a btrfs subvol

Description:

On my system I mount pacman's pkg directory as a btrfs subvol:

/dev/mapper/cryptvar /var/cache/pacman/pkg btrfs   subvol=@var-cache-pacman-pkg,defaults,noatime,autodefrag,compress=zstd,nodev,nosuid,noexec 0 0

Today I noticed first that yay broke & then trying to rebuild yay the new pacman 7.0 was also broken

Additional info:

• package version(s): pacman-7.0.0.r3.g7736133-1-x86_64.pkg.tar.zst
• config and/or log files: my pacman.conf is fairly standard

Steps to reproduce:

pacman -Syu

• I rebooted to make sure there was not a full cache somewhere or something funny going on with btrfs & the issue persisted
• Creating a test file in /var/cache/pacman/pkg worked so I don't think the issue is my btrfs partition (which is just over half full)

[root@endeavour /var/cache/pacman/pkg]# btrfs filesystem df /var/cache/pacman/pkg
Data, single: total=49.47GiB, used=28.43GiB
System, DUP: total=8.00MiB, used=16.00KiB
Metadata, DUP: total=262.00MiB, used=215.58MiB
GlobalReserve, single: total=43.66MiB, used=0.00B

the error itself looked like this:

 libadwaita-1:1.5.4-1-x86_64.pkg.tar.zst failed to download
 orc-0.4.40-1-x86_64.pkg.tar.zst failed to download
 Total (2/2)                     880.2 KiB   280 KiB/s 00:03 [--------------------------------] 100%
error: could not rename /var/cache/pacman/pkg/download-rV45cJ/libadwaita-1:1.5.4-1-x86_64.pkg.tar.zst.part to /var/cache/pacman/pkg/download-rV45cJ/libadwaita-1:1.5.4-1-x86_64.pkg.tar.zst (No space left on device)
error: could not rename /var/cache/pacman/pkg/download-rV45cJ/orc-0.4.40-1-x86_64.pkg.tar.zst.part to /var/cache/pacman/pkg/download-rV45cJ/orc-0.4.40-1-x86_64.pkg.tar.zst (No space left on device)
error: could not rename /var/cache/pacman/pkg/download-rV45cJ/libadwaita-1:1.5.4-1-x86_64.pkg.tar.zst.sig.part to /var/cache/pacman/pkg/download-rV45cJ/libadwaita-1:1.5.4-1-x86_64.pkg.tar.zst.sig (No space left on device)
error: could not rename /var/cache/pacman/pkg/download-rV45cJ/orc-0.4.40-1-x86_64.pkg.tar.zst.sig.part to /var/cache/pacman/pkg/download-rV45cJ/orc-0.4.40-1-x86_64.pkg.tar.zst.sig (No space left on device)
warning: failed to retrieve some files
error: failed to commit transaction (unexpected error)
Errors occurred, no packages were upgraded.

• Downgrading pacman back to pacman-6.1.0-7-x86_64.pkg.tar.zst fixed pacman & yay
• Updating official & aur packages works again
• Most probably this issue is in the filesystem space check in pacman 7.0 with btrfs subvols ?

added priority3-normal severity4-low statusunconfirmed labels

assigned to @freswa, @foxboron, @anthraxx, @toolybird, and @gromit

Most probably this issue is in the filesystem space check in pacman 7.0 with btrfs subvols ?

I also have the cache mounted on a btrfs subvol and see no issues.

Try also btrfs filesystem usage /var/cache/pacman/pkg. Btrfs has known free space quirks.

I see a similar amount of around 58%:

[root@endeavour ~]# btrfs filesystem usage /var/cache/pacman/pkg
Overall:
    Device size:                  50.00GiB
    Device allocated:             50.00GiB
    Device unallocated:            1.00MiB
    Device missing:                  0.00B
    Device slack:                    0.00B
    Used:                         28.85GiB
    Free (estimated):             21.04GiB      (min: 21.04GiB)
    Free (statfs, df):            21.04GiB
    Data ratio:                       1.00
    Metadata ratio:                   2.00
    Global reserve:               43.66MiB      (used: 32.00KiB)
    Multiple profiles:                  no

Data,single: Size:49.47GiB, Used:28.43GiB (57.47%)
   /dev/mapper/cryptvar   49.47GiB

Metadata,DUP: Size:262.00MiB, Used:215.62MiB (82.30%)
   /dev/mapper/cryptvar  524.00MiB

System,DUP: Size:8.00MiB, Used:16.00KiB (0.20%)
   /dev/mapper/cryptvar   16.00MiB

Unallocated:
   /dev/mapper/cryptvar    1.00MiB

but if you have no issues - it must be a quirk on my end ;o)

It seems related to the DownloadUser option. You could try commenting out that option from pacman.conf. According to the man page "If this config option is not set then the downloads are done as the user running pacman." which IIUC, reverts to the pacman-6.1 behavior.

The only other thing that springs to mind is a Btrfs balance?

Either way, this doesn't seem like a pacman packaging issue. If it turns out to be a code issue in pacman itself, it should be reported "upstream" at https://gitlab.archlinux.org/pacman/pacman.

closed

added resolutioncant-reproduce label

The culprit was go creating a bunch of subvols in $GOPATH/.snapshot/xxxx/xxxx that were read-only

($GOPATH was on another subvol of the same device as the pacman subvol)

Booting from a usb & reformatting the btrfs partition / re-creating the subvols was the only way to fully reclaim the space (after btrfs balance the filesystem subcommand still showed 6gb used with everything deleted)

$GOPATH is now on a zram ext4 device so no more surprises ;o)