Add support for high water mark

Created on 15 March 2023, over 1 year ago

Problem/Motivation

When using high_water_property in a migration, migrate_cron does not respect it and always updates everything.

Steps to reproduce

Add something like this to the source configuration:

source:
  high_water_property:
    name: timestamp

Proposed resolution

migrate_cron_cron() forces the update if track_changes is not defined.
It should also check for high_water_property.

Feature request
Status

Closed: duplicate

Version

1.0

Component

Code

Created by

🇫🇷France prudloff Lille

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024