- Issue created by @baikho
- @baikho opened merge request.
The FileMaker API Fetcher for Drupal Feeds module struggles with large datasets, lacking throttling and batch limiting capabilities. This can lead to API failures, timeouts, and inefficient handling of multi-run imports.
Configure a Feed using FileMaker API Fetcher with a large dataset.
Attempt to import the feed.
Observe import failures or inefficiencies with large datasets.
Implement throttling, batch limiting, and improved offset management in the FileMakerApiFetcher class to handle large datasets more efficiently across multiple import runs.
Update FileMakerApiFetcher class with new features.
Modify configuration form to include new options.
Test with various dataset sizes and import scenarios.
Update documentation.
Add fields to Feed type configuration:
Throttle Enable/Disable
Throttle Delay
Maximum Batches per Run
None. Changes are internal to FileMakerApiFetcher class.
None. Will use existing Drupal state storage for managing import progress.
Active
2.0
Code