Pioneer Array glider 335 *.csv files in the data catalog are split into many small-sized files (e.g., 11Mb for the 3-wavelength fluor files). Is there a way of having them merged into a single, larger file prior to download?
-Bob.
Hi Bob,
Unfortunately, there is currently no way to merge the individual files into a single file prior to download. The files are typically sliced up if the data request exceeds 500MB or spans multiple deployments. There is a known bug in the system that occasionally slices up the data request even if it does not exceed 500MB or span multiple deployments, which may be what you are seeing. That bug is in the queue to be addressed in the near future. In the meantime, I can offer you a few solutions for batch downloading the data files in the request. Those can be found here: [How can I download all files at once from a data request? – Ocean Observatories Initiative] Please let me know if those methods make your workflow any easier, and if not, we can discuss some of methods available for querying the OOI M2M API to request data.
Thank you for reaching out!
Collin