It appears that the scraping already occurs during the initialising process via either drush ms, drush mim or drush mr, whilst it should only scrape during the migrate import command.
Run either of the drush status, migrate or rollback commands. All will scrape the URLs.
I believe we should shift the logic from initializeIterator() to prepareRow(), which would then only initiate the scraping at runtime of drush mim during the execution of the relevant row (URL) instead of scraping all URLs at once.
Review the change, create a patch/MR and test.
N/A
N/A
N/A
Active
1.0
Code
Hi @baikho, thanks for your contribution.
I have merged your commits and will soon also work on issue #3505532. After that I will release a first version 1.0.0.
Automatically closed - issue fixed for 2 weeks with no activity.