- Status changed to Fixed
over 1 year ago 10:01pm 1 June 2023 Automatically closed - issue fixed for 2 weeks with no activity.
Right now, it takes ages to validate and index large data items (35K records). UI doesn't even support validation and indexing for the data this large because during the batch process both the process are attempted in one go hence I created #3259685: Allow skipping indexing on Dataset save → .
Given that indexing take 15 min then reindex might take that long as well which would translate into 15 min of downtime for a particular feature relying on that index.
Dataset entity as the data validation only changes the status of its entity.Dataset entity for indexing is a moot point as we only index one entity per queue according to current functionality. Queue DatasetData for indexing instead of Dataset entity.DatasetData just like migration row status. If Dataset entity is set to re-index mark all the corresponding DatasetData to re-index and index them in the queue.DatasetData so that we can remove outdated data from the index and add index update data.Discuss, finalize the apporoch and open the followups.
None.
The changes is validation and indexing process.
None.
Fixed
1.0
Code
Not all content is available!
It's likely this issue predates Contrib.social: some issue and comment data are missing.
Automatically closed - issue fixed for 2 weeks with no activity.