Folder Synchronization should not be done inside a single batch

Created on 25 February 2025, about 1 month ago

Problem/Motivation

When a datasource is using Files synchronization and batch, all the files that are not present in the last processed batch are deleted from the local system.

Steps to reproduce

  • Install the module
  • Configure a Datasource with "Sync" option active and a batch size > 0
  • Run import

Proposed resolution

Move the local files deletion in a separate batch operation, after all import batches have been processed.

Remaining tasks

Test and release MR

User interface changes

API changes

Data model changes

🐛 Bug report
Status

Active

Version

1.0

Component

Code

Created by

🇫🇷France GuillaumePacilly

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

Production build 0.71.5 2024