jlu-ilr-hydro / odmf

Observatory Data Management Framework

MIT License

4 stars 5 forks source link

Import / Export of Dataset or site lists #104

Open philippkraft opened 3 years ago

philippkraft commented 3 years ago

Sometimes datasets need to be created in bulk, eg. distributed sampling at many places with multiple value types. Using a spreadsheet can make this simpler to repeat similar information.

philippkraft commented 2 months ago

[x] Export Sites (no filter)
[x] Export datasets (with filter)
[ ] Import sites
[ ] Import datasets

philippkraft commented 2 months ago

Idea for Import:

class DatasetImportAction(FileAction):
    name = 'import-dataset'
    icon = 'clipboard'
    title = 'dataset'
    tooltip = 'Import datasets'

    def href(self, path: Path):
        return conf.url('/download/to_db/dataset', filename=path.name)

    def check(self, path: Path):
        return False
        try:
            df = pd.read_excel(path.absolute, nrows=1)
            return all(colname in df.columns for colname in ['start', 'end', 'site', 'valuetype', 'project'])    

        except (OSError, ValueError):
            return False

philippkraft commented 2 months ago

Another idea:

Add to datasetlist.html an upload form like in download.html directly under the new dataset button
Add to datasetpage.py a file receiving function that does read_excel and checks the columns (id optional)

Same for sites

download.html

https://github.com/jlu-ilr-hydro/odmf/blob/647f11435be58cd986d15c82f90e13503e7d7508/odmf/static/templates/download.html#L300-L322

Receiving function

https://github.com/jlu-ilr-hydro/odmf/blob/647f11435be58cd986d15c82f90e13503e7d7508/odmf/webpage/filemanager/upload.py#L170-L209