search

treeverse / lakeFS

lakeFS - Data version control for your data lake | Git for data
https://docs.lakefs.io
Apache License 2.0
4.46k stars 359 forks source link

GC+: Create Uncommitted Metaranges #4487

Closed N-o-Z closed 2 years ago

N-o-Z commented 2 years ago
  1. Decide if to start with a global API to create all metaranges - or an API for branch
  2. Decide on the format (SSTable / parquet) - define example format output for client task
  3. Implement API in lakeFS that writes the data to the gc folder to be read by the client
nopcoder commented 2 years ago

Closing this one as dup - done as part of #4475