I retrieve all my New England PA glider data from ERDDAP. The data filenames and data coverage have dramatically changed within the previous year. The current glider data no longer have QARTOD flags, and the coverage is more sparse. For example, for glider 339 for the year 2021 there is currently on ERDDAP only 21 days of data available, but last year when I downloaded the QARTOD-annotated files for the same glider number, the data coverage was something on the order of 100 days. Are you recommending I discontinue use of the older data files? I am concerned because I have gone pretty far into my analyses with these ‘older’ data and would like to continue using these data for 2014 through 2022.
1 Like
Hi Bob,
I assume you are talking about the Glider DAC ERDDAP? ERDDAP - List of tabledap Datasets?
Can you let me know which glider 339 deployment had the filenames and data coverage change significantly? We have 3 deployments from 2021 and I see data for all 3 available on the ERDAPP page.
As for the QARTOD flags - IOOS is still working on the QARTOD flag implementation process. The last update I received about this was from May of this year: “As for now, not all files have been QCed and some files with QC tests are still under investigation. So, it is not surprising that you cannot see the flags with your files. We are working on fixing the issues associated with the QC process, so they are available to users in the near future.”
I cannot recommend that you discontinue the use of the older data files, but I can confirm that we have not modified or re-submitted the raw data files for glider 339 since we initially submitted them back in 2022.
Thank you,
Collin
Hi Collin.
Yes, I used Glider DAC ERDDAP - List of Tabledap Datasets.
To answer you next question, the most current files available for cp_339 for year 2021, and their temporal coverage are:
cp_339-20210131T1640-delayed_d105_10d9_3e1b (March 23 - March 30)
cp_339-20210402T1334-delayed_b515_6859_a46f (April 9 - April 16)
cp_339-20210904T0031-delayed_83cd_2b76_ffa8 (Nov 20 - Dec 6)
For a total of 21 days. But when I downloaded the same glider number for 2021 from glider DAC ERDDAP last year, I got these files (note the filenames were changed by me and have the start and end dates included):
cp_339_2Oct-29Oct_2021
cp_339_4Sep-2Oct_2021
cp_339_10Mar-30Mar_2021
cp_339_17Feb_10Mar_2021
cp_339_24Nov-6Dec_2021
cp_339_29Oct-24Nov_2021
for a total of approximately 128 days.
Why the big reduction in temporal coverage?
thanks, Bob.
Hi Bob,
I think the time constraint might default to the most recent 7 days when you look at a deployment page.
For instance, the deployment page for cp_339-20210131T1640-delayed:
https://gliders.ioos.us/erddap/tabledap/cp_339-20210131T1640-delayed.html
Defaults to a time constraint of “2021-03-23T00:00:00Z” to “2021-03-30T20:16:56Z”
But if you click “make a graph” it shows the temporal range for the deployment is 2021-01-31T17:11:51Z to 2021-03-30T20:16:56Z:
Range: longitude = -71.24981 to -69.821526°E, latitude = 39.369205 to 40.364216°N, depth = -0.188546 to 189.8634m, time = 2021-01-31T17:11:51Z to 2021-03-30T20:16:56Z
I made a table in ERDDAP for temperature data from deployment cp_339-20210131T1640-delayed and it shows data from 2021-01-31 to 2021-03-30:
https://gliders.ioos.us/erddap/tabledap/cp_339-20210131T1640-delayed.htmlTable?time,depth,temperature&time>=2021-01-31T00%3A00%3A00Z&time<=2021-03-31T00%3A00%3A00Z&.draw=markers&.marker=5|5&.color=0x000000&.colorBar=|||||&.bgColor=0xffccccff
So I think you might just need to open up that time constraint when viewing the data.
Thank you,
Collin
Oh jeez. Stupid error. Thanks for clearing that up. I went back and checked and sure enough, that’s what I did wrong.
You mentioned that you did not change the raw glider 339 data in the past year in the glider DAC on ERDDAP, but can you confirm that this is also true for ALL the remaining PA glider data? If so, then I can use the files I already downloaded last year.
-Bob
Hi Bob,
No worries - there is a ton of information and buttons to click on that page!
I took a quick look through my notes and I do not recall modifying and re-submitting any files for these datasets. If you wanted to double check that for any dataset, you could check the last modified timestamp for the files by going to the “Files” tab on the deployment page.
Thank you,
Collin