Develop CORS app

[gubuntu]

The GoCD currently operates four (4) high accuracy GNSS base-stations, which report observations in RINEX, Leica, and Trimble formats. These observations are useful for the post-processing of GNSS observations by surveyors and other data collection personnel. It is the intention of the GoCD to consolidate the collection of these data and streamline access.

The firm will work with the GoCD to consolidate all CORS data on a single server and develop a web based access to this server with read only access (as detailed in Task 3.2.2 of these Terms of Reference).

To streamline the use of these data, the firm will develop an app to extend the DomiNode interface to allow for easy access to the CORS datasets. The app shall:

• Provide an interactive web-map based view of station locations (as points) and status (online/offline/under repair). Additional details such as station names, coordinates, owner and other details deemed necessary by the client may be included in a popup or sidebar for each point on the map.
• Provide the ability to select a site, then as a sidebar or popup interface provide an interface for the user to select a date range of observations to download.
• Provide the ability to control user access to the app by DomiNode administrators. Full public access will be restricted and downloads will require a user account allowed to download by administrators.
• Allow the download of data as a .zip file.
• Implement basic error handling within the app and will include messages on the interface in the case that the date range selected is invalid or data is unavailable.
• Provide warnings to the user in case they have selected a large download (over 50 MB).
• Provide a disclaimer before download and terms of use for user acceptance. The text of this disclaimer will be provided by the LSD.
• Downloading will require confirmation that the user downloading is human (Captcha or similar).
• Human readable logs will be kept of access to the app along with user logons and downloads.

[ricardogsilva]

Here is a comparative CORS download website from NOAA.

[ricardogsilva]

We currently do not know where the CORS data is being persisted. Need to speak to the Dominica stakeholders in order to get some more context, as specified in #31.

[ricardogsilva]

Initial implementation suggestion:

Since we are using GeoNode for the main DomiNode user frontend, we could possibly develop this as an additional django app tat would simply be integrated into GeoNode (we are already doing this for some other stuff). The big upside of this approach is that we'd be able to leverage the already existing GeoNode permission system, which would facilitate handling access controls.

We might leverage GeoDjango to handle the map-related stuff.

[meomancer]

Progress

• [x] Provide an interactive web-map based view of station locations (as points) and status (online/offline/under repair). Additional details such as station names, coordinates, owner and other details deemed necessary by the client may be included in a popup or sidebar for each point on the map.
• [x] Provide the ability to select a site, then as a sidebar or popup interface provide an interface for the user to select a date range of observations to download.
• [x] Provide the ability to control user access to the app by DomiNode administrators. Full public access will be restricted and downloads will require a user account allowed to download by administrators.
• [x] Allow the download of data as a .zip file.
• [x] Implement basic error handling within the app and will include messages on the interface in the case that the date range selected is invalid or data is unavailable.
• [ ] Provide warnings to the user in case they have selected a large download (over 50 MB).
• [ ] Provide a disclaimer before download and terms of use for user acceptance. The text of this disclaimer will be provided by the LSD.
• [x] Downloading will require confirmation that the user downloading is human (Captcha or similar).
• [ ] Human readable logs will be kept of access to the app along with user logons and downloads.

[meomancer]

The checked one mostly already implemented with dummy data

[ricardogsilva]

RINEX reference: https://en.wikipedia.org/wiki/RINEX

[ricardogsilva]

Python FTP libs:

• https://docs.python.org/3/library/ftplib.html - ftplib from the standard library
• https://ftputil.sschwarzer.net/trac/wiki/WikiStart - has a nice API to work with. Personally I prefer it over ftplib