Skip to content
Snippets Groups Projects
New look: Off

db-update doesn't lock properly

    • Closed Issue created by Felix Yan @felixonmars

    Running two db-update instances at the very same time could lead to incomplete locking with errors.

    One instance (the successive one):

    From https://gitlab.archlinux.org/archlinux/packaging/packages/python-cinderclient
   eb34ffa..6185c86  main       -> main
 * [new tag]         9.4.0-1    -> 9.4.0-1
From https://gitlab.archlinux.org/archlinux/packaging/packages/python-prawcore
   d1a5028..91a1795  main       -> main
 * [new tag]         2.4.0-1    -> 2.4.0-1
==> Updating [extra]...
  -> python-cinderclient-9.4.0-1-any.pkg.tar.zst (x86_64)
  -> python-prawcore-2.4.0-1-any.pkg.tar.zst (x86_64)
[main 76a7f4d1f] update python-cinderclient to 9.4.0-1 in extra-any
 1 file changed, 1 insertion(+), 1 deletion(-)
[main d96f1eaf6] update python-prawcore to 2.4.0-1 in extra-any
 1 file changed, 1 insertion(+), 1 deletion(-)

    The other (the failing one):

    error: cannot lock ref 'refs/heads/main': is at 6185c865200e2d03470b2043951c13401f8177e6 but expected eb34ffa892d7f506334b5916e0b679bceda62326
From https://gitlab.archlinux.org/archlinux/packaging/packages/python-cinderclient
 ! eb34ffa..6185c86  main       -> main  (unable to update local ref)
 * [new tag]         9.4.0-1    -> 9.4.0-1
==> ERROR: Couldn't find package python-cinderclient in git!
    To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information

    Child items ...

    • Activity

    • Felix Yan
      Felix Yan @felixonmars ·
      Author Contributor

      Another case:

      error: cannot lock ref 'refs/heads/main': is at 549ca66d229bfb35e73e8156fddef2ca8955d015 but expected f431059303a98f7358fa694079029867b7aea296
From https://gitlab.archlinux.org/archlinux/packaging/packages/python-testfixtures
 ! f431059..549ca66  main       -> main  (unable to update local ref)
 * [new tag]         7.2.2-1    -> 7.2.2-1
==> ERROR: Couldn't find package python-testfixtures in git!
db-update failed, retrying after 5s...
==> ERROR: You don't have permission to update packages in extra
db-update failed, retrying after 5s...
  -> Retrying in 10 seconds...
==> WARNING: Repo [extra] (x86_64) is already locked by orhun.
==> Updating [extra]...
  -> python-testfixtures-7.2.2-1-any.pkg.tar.zst (x86_64)
  -> python-trove-classifiers-2023.10.18-1-any.pkg.tar.zst (x86_64)
[main 5be143fa6] update python-testfixtures to 7.2.2-1 in extra-any
 1 file changed, 1 insertion(+), 1 deletion(-)
[main 67d784af2] update python-trove-classifiers to 2023.10.18-1 in extra-any
 1 file changed, 1 insertion(+), 1 deletion(-)
      From https://gitlab.archlinux.org/archlinux/packaging/packages/python-testfixtures
   f431059..549ca66  main       -> main
 * [new tag]         7.2.2-1    -> 7.2.2-1
From https://gitlab.archlinux.org/archlinux/packaging/packages/python-trove-classifiers
   eabde0b..c5d515b  main         -> main
 * [new tag]         2023.10.18-1 -> 2023.10.18-1
==> ERROR: Repo [extra] (x86_64) is already locked by repo-{add,remove} process 1603882
db-update failed, retrying after 5s...
==> ERROR: You don't have permission to update packages in extra
db-update failed, retrying after 5s...
  -> Retrying in 10 seconds...
==> WARNING: Repo [extra] (x86_64) is already locked by orhun.
  -> Retrying in 10 seconds...
==> WARNING: Repo [extra] (x86_64) is already locked by felixonmars.
  -> Retrying in 10 seconds...
==> WARNING: Repo [extra] (x86_64) is already locked by felixonmars.
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/python-testfixtures-7.2.2-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/python-testfixtures-7.2.2-1-any.pkg.tar.zst' has no pkgname in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/python-testfixtures-7.2.2-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/python-testfixtures-7.2.2-1-any.pkg.tar.zst' has no pkgver in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/python-testfixtures-7.2.2-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/python-testfixtures-7.2.2-1-any.pkg.tar.zst' has no arch in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/python-trove-classifiers-2023.10.18-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/python-trove-classifiers-2023.10.18-1-any.pkg.tar.zst' has no pkgname in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/python-trove-classifiers-2023.10.18-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/python-trove-classifiers-2023.10.18-1-any.pkg.tar.zst' has no pkgver in the PKGINFO. Fail!
==> Removing left over lock from [extra] (x86_64)
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/python-trove-classifiers-2023.10.18-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/python-trove-classifiers-2023.10.18-1-any.pkg.tar.zst' has no arch in the PKGINFO. Fail!
==> ERROR: Package python-trove-classifiers-2023.10.18-1-any.pkg.tar.zst is staged in multiple repos of the same stability layer: extra and
==> ERROR: Ensure that staged packages in outer stability layers must be newer and not staged multiple times in the same layer.
    • Felix Yan
      Felix Yan @felixonmars ·
      Author Contributor

      There could be unhandled exceptions as well:

      bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst' has no pkgname in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst' has no pkgver in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst' has no arch in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst' has no pkgname in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst' has no pkgver in the PKGINFO. Fail!
==> Removing left over lock from [extra] (x86_64)
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst' has no arch in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/ruby-console-1.23.0-1-any.pkg.tar.zst'
/srv/repos/git-packages/dbscripts/db-functions: line 972: array_ref["$key"]: bad array subscript
    • Felix Yan
      Felix Yan @felixonmars ·
      Author Contributor

      More different kind of outputs:

        -> Retrying in 10 seconds...
==> WARNING: Repo [extra-staging] (x86_64) is already locked by felixonmars.
  -> Retrying in 10 seconds...
==> WARNING: Repo [extra-staging] (x86_64) is already locked by felixonmars.
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst' has no pkgname in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst' has no pkgver in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst' has no arch in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst' has no pkgname in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst' has no pkgver in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst' has no arch in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst' has no pkgname in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst' has no pkgver in the PKGINFO. Fail!
==> Removing left over lock from [extra-staging] (x86_64)
==> Removing left over lock from [extra] (x86_64)
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra-staging/haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst' has no arch in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst' has no pkgname in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst' has no pkgver in the PKGINFO. Fail!
bsdtar: Error opening archive: Failed to open '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst'
==> ERROR: Package '/home/felixonmars/staging/extra/perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst' has no arch in the PKGINFO. Fail!
==> ERROR: Package perl-net-dns-sec-1.23-1-x86_64.pkg.tar.zst staged in repo extra is not newer than package haskell-attoparsec-aeson-2.1.0.0-2-x86_64.pkg.tar.zst staged in repo extra-staging
==> ERROR: Ensure that staged packages in outer stability layers must be newer and not staged multiple times in the same layer.
    • Levente Polyak added scopebug label

      added scopebug label

    • Levente Polyak assigned to @anthraxx

      assigned to @anthraxx

    • Levente Polyak closed with commit d4dbd0c1

      closed with commit d4dbd0c1

    • Levente Polyak closed with commit c56bd172

      closed with commit c56bd172

    Please register or sign in to reply