1. 19 Dec, 2013 1 commit
  2. 18 Dec, 2013 2 commits
    • Dan McGee's avatar
      reporead: implement delayed parsing of files data · ac157895
      Dan McGee authored
      
      
      This gives us some large memory savings in python due to the internal
      storage of Unicode strings vs. byte strings, as well as saving us
      processing time up front for filelist data we are never going to have to
      actually use.
      
      Signed-off-by: default avatarDan McGee <dan@archlinux.org>
      ac157895
    • Dan McGee's avatar
      reporead: bring back batched_bulk_create() · 8e8e3d7a
      Dan McGee authored
      
      
      For packages with filelists with > 80,000 items, we were starting to see
      some serious memory issues in reporead. This was both on the statement
      generation side in Python as well as on the database side. Break the
      updates into chunks of 10,000 when we encounter packages with tons of
      files to control things in a bit.
      
      Signed-off-by: default avatarDan McGee <dan@archlinux.org>
      8e8e3d7a
  3. 15 Dec, 2013 4 commits
  4. 14 Dec, 2013 10 commits
  5. 03 Dec, 2013 1 commit
  6. 27 Nov, 2013 5 commits
  7. 26 Nov, 2013 6 commits
  8. 12 Nov, 2013 1 commit
  9. 11 Nov, 2013 1 commit
    • Dan McGee's avatar
      Filtered requiredby list for non-primary depends · 833798f4
      Dan McGee authored
      
      
      For something like gambas3 which has a makedepend on postgresql, we end
      up getting every single split package listed in the required by list for
      postgresql. This is a bit crazy and unnecessary, so slim it down a bit
      when possible by using a slightly crazy groupby function and some smarts
      in our get_requiredby function.
      
      Signed-off-by: default avatarDan McGee <dan@archlinux.org>
      833798f4
  10. 08 Nov, 2013 1 commit
  11. 07 Nov, 2013 8 commits