Contrib.social

Migrate Tools Rollback, use batch process if possible

Open on Drupal.org →
Created on 16 November 2018, almost 7 years ago
Updated 17 May 2023, over 2 years ago

Currently using migrate tools to work on a rather complex migration. Profiles come in, and some of the data creates paragraphs, and some of those paragraphs go onwards to generate group content. Deletion is just as complex. Remove a node, remove paragraphs, remove paragraphs, remove group content.

With 1059 records (a sample of the full amount we have to migrate) whenever I run migrate currently I get a 504 bad gateway response. The rollback runs partially through the records to remove, but ultimately times out. Updating this to using a batch process would be helpful.

✨ Feature request
Status

Needs work

Version

6.0

Component

Code

Created by

🇺🇸United States jnicola

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

  • Open in Jenkins → Open on Drupal.org →
    Core: 10.1.x + Environment: PHP 8.1 & MySQL 8
    last update over 2 years ago
    36 pass
  • @vasike opened merge request.
  • Status changed to Needs review over 2 years ago
  • Comment over 2 years ago →
    🇷🇴Romania vasike Ramnicu Valcea

    i created a MR from the previous patches ... replacing the rollback with batch rollback.

    Maybe some code could be cleanup ... so anyone that wants to. help, please update the MR ...

  • Comment over 1 year ago →
    🇨🇦Canada jaypan Victoria, BC

    I've confirmed this is working, and it is actually essential for me as my system times out and rollbacks are impossible when they are not done through a batch. I'm marking this as major, as this bug prevents module functionality for me.

  • Comment over 1 year ago →
    🇧🇬Bulgaria ovanes Sofia

    I have rerolled the patch for version 6.0.x

  • Comment over 1 year ago →
    🇵🇱Poland sergey.semchuk

    I updated the patch added in comment #11
    Deleted the not needed "sprintf('%s::%s', static::class, 'batchProcessImport')" which was breaking Migration Batch execution

  • Status changed to Needs work 3 months ago
  • Comment 3 months ago →
    heddn Nicaragua

    This could use a re-base and review if everything is in the MR.

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024