brimdata / super

A novel data lake based on super-structured data
https://zed.brimdata.io/
BSD 3-Clause "New" or "Revised" License
1.39k stars 64 forks source link

tool to create directory hierarchy of zng files #532

Closed alfred-landrum closed 4 years ago

alfred-landrum commented 4 years ago

Following the zar prototype work in https://github.com/brimsec/zq/pull/482, we need a tool that would read zng records and distribute them into a directory hierarchy of bzng files. zar would then be able to create indices for each bzng file in its directory.

alfred-landrum commented 4 years ago

Initial implementation is at https://github.com/brimsec/zq/pull/533 as a subcommand of zar.