Consider a queue approach

Created on 3 July 2024, 6 months ago

Problem/Motivation

A queue would have some benefit to running large operations more reliably. However, architecturally it would have some complications.

Complications:

  1. Being able to reliably claim a batch operation is done. - In order to come close to this, each batch operation would need its own queue
  2. Avoiding multiple runs of the Batch operation putting something in the queue twice - deduping a queue becomes very expensive if deduping on addition.... though possibly faster if deduped after the additions are complete
  3. Is the drush command and the UI run considered complete when the queue is fully populated or fully run? This would have implications to running in an update or deploy hook which would need all things to be fully done.
  4. The queue item would have to refernence a specific batchop log in order to know which one to append data to.
  5. Queue items might need a flag to say "I am the first of my run" or "I am the last of my run" ... or maybe different Batch op log ids would denote that.

Steps to reproduce

Proposed resolution

Remaining tasks

User interface changes

API changes

Data model changes

✨ Feature request
Status

Active

Version

1.0

Component

Code

Created by

πŸ‡ΊπŸ‡ΈUnited States swirt Florida

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024