Import Progress Bar - for All items

Created on 24 April 2023, about 1 year ago
Updated 25 April 2023, about 1 year ago

Problem/Motivation

Currently, when you do a CSV import (and I assume other imports), once you begin the import in the foreground you get a page that shows the import progress for the current item.
This is okay if you are importing a few items, but if you are importing thousands you see only the same progress bar with no indication of the overall progress of the import. It would be useful to either make this progress bar grow based on the overall progress of the import, or to display this information on the page alongside the progress-bar.

This may be related to https://www.drupal.org/project/feeds/issues/2996579 β†’ - but I think this may be more related to the Import in Background page.

Steps to reproduce

Import a CSV file in a Feed that has many entries with many mappings.
The progress screen's progressbar keeps looping through from 0-100 without indication of overall feed progress.

Proposed resolution

Change the progressbar to reflect overall progress and update messaging (e.g. Processing Item 5 of 2090... etc) or add an overall progressbar below the per-item bar.

Remaining tasks

User interface changes

Updates to the Import page after the user creates the feed.

API changes

Data model changes

✨ Feature request
Status

Closed: duplicate

Component

User interface

Created by

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @mslaxmeter
  • Status changed to Closed: duplicate about 1 year ago
  • πŸ‡³πŸ‡±Netherlands MegaChriz

    There is already an issue about this, see πŸ› Bouncing progress bar Active . So closing this one as a duplicate.

    The reason is that each stage of the import happens in its own batch. So you get a serie of batches.

    This is the import workflow, each step has its own batch:

    1. Fetch data
    2. Parse data
    3. Process a number of items
    4. If there's more to parse, repeat step 2 and 3.
    5. If there's more to fetch, repeat step 1 till 4.

    An other issue is that Feeds cannot predict accurately how many items will be processed in the end. But I think this is mostly an issue when multiple fetches happen. Because in a second fetched file there could be 10 items, but there could also be 2000 items. In Feeds itself, only the directory fetcher does multiple fetches.

    I would like to see this issue fixed, but because I have enough other Feeds tasks to do that I consider to be a higher priority I think I won't pick this one up myself in the nearby future.

Production build 0.69.0 2024