Find some generic formatting, transformation, DSL, filtering, scripty language to embed in the yaml and run on the data

alexkreidler / wiz

An ML platform + package manager.

https://wiz-project.ml/

Apache License 2.0

4 stars 1 forks source link

Find some generic formatting, transformation, DSL, filtering, scripty language to embed in the yaml and run on the data #23

Open alexkreidler opened 4 years ago

alexkreidler commented 4 years ago

python
filtery dsl
Go filters on native data aren't great
some DSL which is frontend to the Apache Arrow/FoundationDB ETL layer

Processor API extensibility/chaining/merging Use multiple ProcAPIs -- e.g. use the regular executor one, but an additional special one for the ETL layer -- all kernels exposed as processors with their own configs etc