OO data not found (code 404) since 2022-02-19 = 3.5 days

HelpDesk
1

OO data not found (code 404) since 2022-02-19 = 3.5 days.
IRIS is getting response code 404 for 6 different URLs:

url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03CCAL/MJ03F/05-BOTPTA 301 /streamed/botpt_ nano _sample?include_provenance=true&format=application/netcdf&beginDT=2022-02-21T09:40:18.750000Z&endDT=2022-02-21T13:40:18.750000Z response 404

url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03CCAL/MJ03F/05-BOTPTA 301 /streamed/botpt_ lily _sample?include_provenance=true&format=application/netcdf&beginDT=2022-02-21T09:40:18.000000Z&endDT=2022-02-21T13:40:18.000000Z response 404

url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03ECAL/MJ03E/06-BOTPTA 302 /streamed/botpt_ nano _sample?include_provenance=true&format=application/netcdf&beginDT=2022-02-21T13:40:18.800000Z&endDT=2022-02-21T17:40:18.800000Z response 404

url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03ECAL/MJ03E/06-BOTPTA 302 /streamed/botpt_ lily _sample?include_provenance=true&format=application/netcdf&beginDT=2022-02-21T09:40:18.000000Z&endDT=2022-02-21T13:40:18.000000Z response 404

url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03INT2/MJ03D/06-BOTPTA 303 /streamed/botpt_ nano _sample?include_provenance=true&format=application/netcdf&beginDT=2022-02-21T13:40:18.450000Z&endDT=2022-02-21T17:40:18.450000Z response 404

url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03INT2/MJ03D/06-BOTPTA 303 /streamed/botpt_ lily _sample?include_provenance=true&format=application/netcdf&beginDT=2022-02-21T13:40:17.100000Z&endDT=2022-02-21T17:40:17.100000Z response 404

2

Hello,

Thanks for sending the note! We are currently investigating the source of the data interruption. An unknown communications issue between the primary nodes and shore station caused the science ports to be turned off, and an annotation will be added to all platforms and instruments that were affected during that time. The science ports have been reactivated, and all bottom pressure and tilt (BOTPT) units should now be online and recording data. Please let us know if you encounter any further interruptions.

Thanks,
Mike Vardaro
UW Data Team

3

This cam back for a few days but its down again - IRIS is getting 404 response for data:

tail -n10 OOI_data*.log | grep 404
url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03CCAL/MJ03F/05-BOTPTA301/streamed/botpt_nano_sample?include_provenance=true&format=application/netcdf&beginDT=2022-03-01T09:45:09.850000Z&endDT=2022-03-01T13:45:09.850000Z response 404
Request [FAILED] - exiting! status_code: 404
url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03CCAL/MJ03F/05-BOTPTA301/streamed/botpt_lily_sample?include_provenance=true&format=application/netcdf&beginDT=2022-03-01T09:45:07.800000Z&endDT=2022-03-01T13:45:07.800000Z response 404
Request [FAILED] - exiting! status_code: 404
url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03ECAL/MJ03E/06-BOTPTA302/streamed/botpt_nano_sample?include_provenance=true&format=application/netcdf&beginDT=2022-03-01T09:45:09.600000Z&endDT=2022-03-01T13:45:09.600000Z response 404
Request [FAILED] - exiting! status_code: 404
url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03ECAL/MJ03E/06-BOTPTA302/streamed/botpt_lily_sample?include_provenance=true&format=application/netcdf&beginDT=2022-03-01T09:45:08.800000Z&endDT=2022-03-01T13:45:08.800000Z response 404
Request [FAILED] - exiting! status_code: 404
url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03INT2/MJ03D/06-BOTPTA303/streamed/botpt_nano_sample?include_provenance=true&format=application/netcdf&beginDT=2022-02-28T01:45:08.000000Z&endDT=2022-02-28T05:45:08.000000Z response 404
Request [FAILED] - exiting! status_code: 404
url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03INT2/MJ03D/06-BOTPTA303/streamed/botpt_lily_sample?include_provenance=true&format=application/netcdf&beginDT=2022-02-28T01:45:07.000000Z&endDT=2022-02-28T05:45:07.000000Z response 404
Request [FAILED] - exiting! status_code: 404

Example for one data set - we get 2 x 200’s then a 404:

url for deploymentId: https://ooinet.oceanobservatories.org/api/m2m/12587/events/deployment/inv/RS03INT2/MJ03D/06-BOTPTA303 response 200

url for deploymentInfo: https://ooinet.oceanobservatories.org/api/m2m/12587/events/deployment/inv/RS03INT2/MJ03D/06-BOTPTA303/1 response 200

url for data: https://ooinet.oceanobservatories.org/api/m2m/12576/sensor/inv/RS03INT2/MJ03D/06-BOTPTA303/streamed/botpt_lily_sample?include_provenance=true&format=application/netcdf&beginDT=2022-03-01T09:45:07.800000Z&endDT=2022-03-01T13:45:07.800000Z response 404 Request [ FAILED ] - exiting! status_code: 404

4

Yeah, the glitch returned on 2/26 and the Axial instruments were gradually turned back on between March 1st and 3rd. Data should be streaming again now. All gaps should have the following annotations as well: “A glitch in the OOB network triggered a failsafe condition in PN03A and PN03B that cut power to the science ports on these primary nodes. As a result, instruments and nodes downstream of 3A and 3B were offline.” The investigation into what is creating this glitch is still ongoing, although it did not recur this weekend (which is a positive sign).