- Issue created by @cman9090
When attempting to process large JSON files we are running into memory limit due to JsonSource.php needing to load the entire file into memory for JSON decoding.
- PHP memory limit 400MB
- Add pipeline and add a JSON file that is 80MB.
- Should fail during it's attempt to process.
- Update JsonSource.php to use JSON streaming using the package halaxa/json-machine.
- This ensures we don't run into memory limit issues.
- Review patch
Active
1.0
Code