feature: massive logs streaming

Netflix / metaflow-service

:rocket: Metadata tracking and UI service for Metaflow!

http://www.metaflow.org

Apache License 2.0

193 stars 71 forks source link

Closed saikonen closed 5 months ago

saikonen commented 5 months ago

Alternative approach to streaming massive logs. Does not require any changes to Metaflow client side.

Intended to supersede #423

TODO:

[x] support legacy logs
[x] reliable cache/GC of the raw log downloads on disk so they can be reused across cache action calls.