search

Swirrl / table2qb

A generic pipeline for converting tabular data into rdf data cubes
Eclipse Public License 1.0
14 stars 4 forks source link

Support EDN as an alternative --column-config #73

Open RickMoynihan opened 6 years ago

RickMoynihan commented 6 years ago

We currently read CSV files as pipeline config; internally these are read and generate an in memory configuration structure as EDN. It would be useful for programatic use cases to be able to target the EDN configuration directly, e.g. from within unit tests etc.

For this feature to result in a super friendly workflow I can imagine a few useful options would be:

  1. To run table2qb on a --column-config CSV file and output its config map to stdout as EDN.
  2. To be able to read an EDN --column-config
  3. In the table2qb API be able to use an EDN value programatically (you can probably do this already) but we should document it & check it's friendly for developer/library style usecases.

1 would allow workflows where a customer can give us a CSV config and we can convert it to an EDN based one for test cases etc

Robsteranium commented 6 years ago

~Duplicate of #4?~ (that refers to csvw metadata, this is about the column-config)