Contrib.social

Add support for queueing invalidations

Open on Drupal.org →
Created on 8 November 2023, over 1 year ago

Problem/Motivation

When Drupal removes temporary files, the number of delete actions causes CloudFront errors due to the volume of individual invalidations being processed.

Steps to reproduce

  1. Modify or delete a number of files
  2. Wait 6 hours (or your site's determined amount of time between delete and removal of files
  3. View logs to see AWS Rate Limit errors

Proposed resolution

  • Allow the user to select between immediate or queued processing
  • Require the user to select the queuer to process invalidations
  • Adjust logic to queue invalidations instead of using selected process for immediate invalidation

Remaining tasks

  • Submit merge request with form and logic changes

User interface changes

  • Required select for Workflow: queued or immediate
  • Required select of Queuer to submit queued invalidations to
✨ Feature request
Status

Active

Version

1.1

Component

Code

Created by

🇺🇸United States kevinb623

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

  • Issue created by @kevinb623
  • Merge request !6#3400166 - Enable queueing of invalidation requests → (Open) created by kevinb623
  • Comment 8 months ago →
    🇦🇺Australia dpi Perth, Australia

    The motivation is good, however the implementation needs work

  • Status changed to Needs work 8 months ago
  • Comment 8 months ago →
    🇦🇺Australia dpi Perth, Australia
  • First commit to issue fork.
  • Comment 27 days ago →
    🇪🇸Spain omarlopesino

    This issue is really interesting, thanks for the contribution @kevinb623 . Supporting queues may drastically improve the performance when there are too many URLs to purge.

    Also many thanks for helping reviewing @dpi, it saved me time.

    The most priority changes needed to merge this are:

    1. Make form labels translatable
    2. Hook install to configure existing sites.
    3. Coding standards must pass, Currently, this module is integrated with Gitlab CI to help on this purpose.
    4. Ideally, applying every suggestion mentioned in the feedback.
contrib.social Blog FAQ Discussions
Production build 0.71.5 2024