Batch processing: how to use and where are the files?

Created on 19 December 2024, 4 months ago

Problem/Motivation

I have 2 views and in view #1, the data exporting to CSV is working. But in view #2, it is not...no error in the UI or log file. View #2 has much more data (max about 301,000 rows with 15 simple columns of text and numbers and a global counter column) so I unchecked the "Download immediately" which I presume means batch download but I can't tell if it is working or not. I cannot find the files in the public location (web/sites/default/files/) and we have no private system setup yet.

I have looked through the module documentation and the help and can't figure out what's wrong and how to use the batch mod. I'm using D10.2.11. All help is appreciated...

💬 Support request
Status

Active

Version

1.4

Component

Documentation

Created by

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @monaw
  • 🇬🇧United Kingdom steven jones

    @monaw thanks for the support request.

    If you have unchecked the 'Download immediately' option, then you should be getting a message on the completion page that gives you a link to download the file. But that's only used when in batch mode, as you seem to have noticed.
    It's not the 'batch mode' option however, in the UI there's a 'Export settings' section, and that's where you can set the view to use batch mode (or not):

    Let me know if that helps.

  • thank you Steven!

    Ok, I've updated my settings (see attached 2 images) and double checked my filesystem settings (see attached image) but I still see nothing after clicking on the CSV icon. I also used the find command to look for "WFDB*" but it didn't find anything either. I checked my recent log and I see message about cron...does the batch data export go through cron? the only error message i see in the recent log is cron not able to send out email...

  • 🇬🇧United Kingdom steven jones

    Are you seeing any of the batch processing pages? I'm guessing that maybe you're not, because you have a very large batch processing size of 50,000. Try something more like 50, and see if that starts working, then maybe aim for something more like 1000 if processing can be completed fast enough.

Production build 0.71.5 2024