pvgenuchten
commented
6 months ago I wonder if this functionality is needed (in the first iteration) it makes sense as part of #6, but on any file uploaded by users?
Same comment here as in #6, they should also upload a alignment configuration, if they want to apply a model transformation.
For sure for a simple format or projection configuration, online gdal may be sufficient?
SoilWise Repository will enable user to manually upload data for their on-the-fly processing within the SWR. Capacity of the SWR will be significantly limited; however, a demonstration of manual data upload and their processing, e.g. transformation of coordinate systems or measurements units.
Origin: D1.3 Repository architecture
With acceptance criteria:
Manually Upload Ingest Data
[x] Users should be able to access a clearly labeled "Upload Data" button or menu option from the main interface.
[x] The upload interface should accept common file formats such as CSV, JSON, XML, and Excel.
[x] A progress indicator should be displayed during the upload process to inform users of the status.
[x] Users can select and upload files from their local system.
[x] The system should validate the uploaded file's format and content before processing. If the file is invalid, an informative error message should be displayed.
[x] Uploaded data should be ingested and stored in the central database for further processing.
[x] Upon successful upload, the system should display a confirmation message.
[x] If the upload fails, the system should provide a clear and actionable error message.
[x] Ensure that only authenticated users can upload data.
[x] Uploaded files should be scanned for viruses and malware.
[x] Provide user documentation or tooltips within the UI to guide users on how to use the upload and transformation features.
[x] Include detailed error messages and troubleshooting steps.
On-the-Fly Processing Within the SWR: Transformation of Coordinate Systems
[x] Users should have the option to specify the desired coordinate system transformation when uploading data or from a settings menu.
[x] An alignment-configuration can be stored for each distribution in a dataset metadata
[x] Users can contribute an alignment-configuration
[x] A transformation process can process the alignment-configuration to produce a transformed dataset
[x] The system should accurately transform coordinates from the source coordinate system to the target coordinate system during the upload process.
[x] Transformed data should be stored correctly in the central database with the appropriate coordinate system metadata.
[x] Display a message confirming the successful transformation of coordinate systems after processing.
[x] If the transformation fails, the system should provide an informative error message indicating the reason for the failure.
[x] The transformation process should be efficient and not significantly delay the upload process.
On-the-Fly Processing Within the SWR: Transformation of Measurements Units
[x] Users should have the option to specify the desired measurement units for data transformation when uploading data or from a settings menu.
[x] An alignment-configuration can be stored for each distribution in a dataset metadata
[x] Users can contribute an alignment-configuration
[x] A transformation process can process the alignment-configuration to produce a transformed dataset
[x] The system should accurately transform measurement units from the source units to the target units during the upload process.
[x] Transformed data should be stored correctly in the central database with the appropriate units metadata.
[x] Display a message confirming the successful transformation of measurement units after processing.
[x] If the transformation fails, the system should provide an informative error message indicating the reason for the failure.
[x] The transformation process should be efficient and not significantly delay the upload process.