general: all commands should be filters

lovasko / swim

:swimmer: swim: Time Series Database Combinators

BSD 2-Clause "Simplified" License

0 stars 0 forks source link

Open lovasko opened 7 years ago

lovasko commented 7 years ago

following the UNIX philosophy, all commands should be able to run as filters
this would enable features such as swim select -b ${BEGIN} -e ${END} | swim info

lovasko commented 7 years ago

this might be a problem, since we support 2 header-less formats (compressed and raw) separated only by the file extension (.gs and .gsz)
if all commands were to produce only raw format and write only the raw format, this would be solved
nice thing about raw format is that it is editable by other tools in the pipeline too (head -c, tee od, ...)
special command in this regard is swim compress that can be the last part of a transformation pipeline