DFO-NOAA-Pacific / surveyjoin

Repo for combining trawl survey data from NOAA and Fisheries and Oceans Canada in Northeast Pacific
https://dfo-noaa-pacific.github.io/surveyjoin/
9 stars 0 forks source link

Future access to NWFSC survey data #56

Open chantelwetzel-noaa opened 1 week ago

chantelwetzel-noaa commented 1 week ago

The NWFSC is currently planning to move away from the current approach to access survey data via the NWFSC data warehouse and API access. The current plan is for the current system to remain in place through early 2025, but there are some potential situations where it could be eliminated sooner. How these data will be stored and accessed after the data warehouse is taken offline is not yet clear, but access to the data will most likely be restricted to the public and outside collaborators. Additionally, once the data are transitioned to a new database, it is unclear if the format of the data will align with the expected nwfscSurvey format and current data filters which may require the development of translation scripts to ensure the same data are returned and to support the use of nwfscSurvey functions (and any other existing scripts that expect the existing data structure).

I am pretty unhappy with these changes and the challenges they will like pose to external collaborations and projects like this one, but I will do my best to provide updates as they become available so we can plan on best to maintain the functionality of this package.

Lewis-Barnett-NOAA commented 1 week ago

That is very unfortunate indeed. Let's just keep in touch about how it evolves I suppose. Sorry to hear that.

On Wed, Nov 13, 2024 at 12:28 PM Chantel Wetzel @.***> wrote:

The NWFSC is currently planning to move away from the current approach to access survey data via the NWFSC data warehouse and API access. The current plan is for the current system to remain in place through early 2025, but there are some potential situations where it could be eliminated sooner. How these data will be stored and accessed after the data warehouse is taken offline is not yet clear, but access to the data will most likely be restricted to the public and outside collaborators. Additionally, once the data are transitioned to a new database, it is unclear if the format of the data will align with the expected nwfscSurvey format and current data filters which may require the development of translation scripts to ensure the same data are returned and to support the use of nwfscSurvey functions (and any other existing scripts that expect the existing data structure).

I am pretty unhappy with these changes and the challenges they will like pose to external collaborations and projects like this one, but I will do my best to provide updates as they become available so we can plan on best to maintain the functionality of this package.

— Reply to this email directly, view it on GitHub https://github.com/DFO-NOAA-Pacific/surveyjoin/issues/56, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAKMJPY4YM5VAHPDPPZQP3L2AOY77AVCNFSM6AAAAABRXK73CWVHI2DSMVQWIX3LMV43ASLTON2WKOZSGY2TMNRXHE2TCNQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

-- Lewis Barnett, PhD (he/him) Research Fish Biologist

NOAA Fisheries, Alaska Fisheries Science Center 7600 Sand Point Way NE, Bldg 4 Seattle, Washington 98115 Google Voice: (206) 526-4111