BOTPT no longer updating on the Data Explorer

HelpDesk
1

Last week, I noticed that the BOTPT datasets on the Data Explore seem to have ceased at the end of March. However, real-time data is still available on the Data Portal (ooinet). Is this a temporary glitch?

2

Hello,

This is an issue with the data ingestion into Data Explorer, and is a temporary glitch. The BOTPT data streams are up and running, and available through OOINet.

Cheers,

Wendi

RCA Data Team

3

Hi there, just noticed again today that the BOTPT data streams in the Explorer appear to have stopped in October. But there’s still real-time data available in Thredds. Wondering if it’s the same glitch. Thanks!

4

Thanks Sage! I’ll go check in with CI and Axiom and see if something needs a kick.

I’ll update when we know more.

5

Just an update on this:

It’s apparently a metadata issue, and resolution is in progress. Sometime in October there was a patch to the ingestion code in response to asset management changes which broke the ingestion code’s ability to correctly match the parameter from the netCDF metadata to the existing data for some instruments. A fix was put in place, but the number of parameters and streams in the BOTPT data (combined with some inconsistent naming rules) left some of them out.

BOTPTs 301 and 302 have been manually updated, and 303 and 304 are being worked on.

6

So many moving pieces. Thanks, Mike, for the update!

7

Hi again!

Just ran a spot check on Data Explorer and all the BOTPT parameters from all four instruments appear to be up-to-date and updating normally. OOI Data Explorer

Let me know if you see any I missed and I’ll follow up with the devs. Otherwise I’ll close out this ticket until the next hiccup…

Thanks,
Mike

8

Mike, thanks for the update. Looks like the Data Explorer is ok, but Erddap still has some gaps

  • 301 Central - Gap
  • 302 Eastern - OK
  • 303 International - Weirdly, the green download button links in the portal for this are different. Erddap isn’t even listed.
  • 304 Ashes - Gap
9

Okay, Axiom has filled in the gaps on THREDDS, so they should all be up-to-date now.

Also, Luke let me know that BOTPTA303 is a “high-res” instrument and should be downloaded from DE instead of from ERDDAP. I think the other ones had their sampling turned down to resolve some connectivity issues.

Let me know if you see any other inconsistencies!

-Mike

1 Like