[meta] Ginormous File Directory Issues + Fixes

Created on 4 January 2016, over 9 years ago
Updated 15 March 2016, about 9 years ago

So

Some sites that have ginormous file directories (> 5GB) start to do odd things on the unmanaged side.

Sad things that will happen sadly are:

  1. I cant get it to sort properly
  2. ajax pager failz
  3. It will duplicate the entity table I made for some reason after deleting a file

Possible solutions:

  1. do a serialized data structure per sub directory
  2. add caching more gooder
  3. add option to truncate entity table as an operations fail safe
🌱 Plan
Status

Active

Version

1.0

Component

Code

Created by

πŸ‡ΊπŸ‡ΈUnited States labboy0276

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

  • πŸ‡ΊπŸ‡ΈUnited States redbrickone

    I'd love to see some movement on this issue.
    I don't think a site having a lot of files saved on the server is a small use-case.

    I'm working on a site that has +3GB of files.
    I'm generally unable to even open the Files Unmanaged tab as it takes too long to load. If it does end up loading, it just says "There are no unmanaged files in your system!" after taking 5+ minutes to load.

    When trying to delete all items in the Orphaned Files tab at once, the batch eventually fails and does not continue.
    FWIW - My orphaned files is close to 115,000 images which is over 2300 pages of 50 orphaned files.

    Is there a better method to clear these out other than doing one page at a time?

Production build 0.71.5 2024