Import a datapackage with metadata

[spine-o-bot]

In GitLab by @ererkka on Jul 26, 2018, 16:14

Spine toolbox should be able to import a datapackage including metadata (author, created, source, licenses, etc.). Attached is an example of such a package dp_example.zip

Questions

1. How are the metadata stored in the Spine data store (.sqlite)?
2. How does the user choose, which data is this for?
3. Should we use some additional attributes in the datapackage.json file? Like this: "spine_attrs": { "geography": "Finland", "notes": "", "location": "", "frequency": "1 hour"}

Actions

• [x] Infer tabular schema from a csv file and write create/update datapackage.json.
• [ ] Data types check (issue #250)
• [ ] Enter and edit metadata (issue #142)
• [ ] Data validation: set value boundaries, handling missing values etc.
• [ ] Define mapping from field names to Spine data store names (issue #251)
• [x] Export to Spine format (Data Store)

[jkiviluo]

This shouldn't be just about datapackage. We currently have some support for metadata in the importer, but we need more. There should be multiple metadata rows available that can be used flexibly to entities, entity classes, and parameter values. There should be ability to add the metadata key in addition to the value for whatever is read from the source.

I know this is not clear issue description yet, but just dropping here as a warning.