Contrib.social

Migrate Tools Rollback, use batch process if possible

Open on Drupal.org →
Created on 16 November 2018, over 6 years ago
Updated 24 February 2024, about 1 year ago

Currently using migrate tools to work on a rather complex migration. Profiles come in, and some of the data creates paragraphs, and some of those paragraphs go onwards to generate group content. Deletion is just as complex. Remove a node, remove paragraphs, remove paragraphs, remove group content.

With 1059 records (a sample of the full amount we have to migrate) whenever I run migrate currently I get a 504 bad gateway response. The rollback runs partially through the records to remove, but ultimately times out. Updating this to using a batch process would be helpful.

✨ Feature request
Status

Needs review

Version

6.0

Component

Code

Created by

🇺🇸United States jnicola

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

  • Open in Jenkins → Open on Drupal.org →
    Core: 10.1.x + Environment: PHP 8.1 & MySQL 8
    last update almost 2 years ago
    36 pass
  • @vasike opened merge request.
  • Status changed to Needs review almost 2 years ago
  • Comment almost 2 years ago →
    🇷🇴Romania vasike Ramnicu Valcea

    i created a MR from the previous patches ... replacing the rollback with batch rollback.

    Maybe some code could be cleanup ... so anyone that wants to. help, please update the MR ...

  • Comment about 1 year ago →
    🇨🇦Canada jaypan Victoria, BC

    I've confirmed this is working, and it is actually essential for me as my system times out and rollbacks are impossible when they are not done through a batch. I'm marking this as major, as this bug prevents module functionality for me.

  • Comment about 1 year ago →
    🇧🇬Bulgaria ovanes Sofia

    I have rerolled the patch for version 6.0.x

  • Comment about 1 year ago →
    🇧🇾Belarus sergey.semchuk

    I updated the patch added in comment #11
    Deleted the not needed "sprintf('%s::%s', static::class, 'batchProcessImport')" which was breaking Migration Batch execution

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024