Utils to write/read flow dataset to/from edn file - Githubissues

akvo / akvo-lumen

Make sense of your data

https://akvo.org/akvo-lumen

GNU Affero General Public License v3.0

63 stars 18 forks source link

Utils to write/read flow dataset to/from edn file #3085

Closed tangrammer closed 3 years ago

tangrammer commented 3 years ago

So we can use these edn files to import/update flow dataset in dev/test envs without connecting to akvo-flow-api external service

eg workflow

dev> (refresh)
dev> (go)
dev> (activate-write-locally-flow-data)

then import a flow datasets using normal web UI

If you don't want to write more edn files just call (deactivate-write-locally-flow-data)

Problems solved:

[X] read edn with tagged literals eg: java.util.Instant
[x] added support for lumen geo types
[x] always output to a dev directory ignored(included in gitignore)

Used this uat1 form to generate edn files

Screenshot 2020-12-31 at 18 03 53

Files generated:

Screenshot 2021-01-04 at 12 25 12

Dataset generated using these edn files

Screenshot 2020-12-31 at 18 03 15

[ ] Update release notes if necessary

kardan commented 3 years ago

Should we add a function in dev that have a hardcoded reference to the filename? Then it would be easy to import as part of CI or just in general if you don't want to eval code but play with Lumen and Flow data locally?