Contrib.social

Handling large datasets

Open on Drupal.org →
Created on 27 May 2025, 2 months ago
Updated 25 June 2025, about 1 month ago

Problem/Motivation

Fatal error when opening Media Folder with a large database.

Fatal Error Code
Fatal error: Allowed memory size of 1073741824 bytes exhausted (tried to allocate 20480 bytes) in /var/www/html/docroot/core/lib/Drupal/Core/Entity/Sql/SqlContentEntityStorage.php on line 599

Steps to reproduce

  1. Install Media Folders Module
  2. Import a database (if available a large database)
  3. Open Media Folder Module

Proposed resolution

This maybe ignorance or a lack of knowledge in the module architecture and time may needed to understand the code base. If this is helpful then great.

Can the total number of files be parsed to get a head count or up to a known/safe data size then rendered in the module?
When more data is requested they're recursive pulled into the memory stack replacing the old group off the stack and rendered to the screen.
It feels like the modules attempts to load all files all at once and the theory is this may cause fatal error.

Opening initial issue to inform, updates and testing will be needed to true confirm this.

✨ Feature request
Status

Active

Version

1.0

Component

Code

Created by

mtinife

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024