search

xtracthub / xtract-service

Globus Labs Xtract: Extract metadata from distributed data sets.
6 stars 1 forks source link

Too big of a commit... #35

Closed tskluzac closed 3 years ago

tskluzac commented 3 years ago
  1. Adding dataset metadata.
  2. Fully operational (but needs tuning) on-service prefetcher.
  3. Step-by-step task counting/tracking.
tskluzac commented 3 years ago

This PR adds everything from the aforementioned commit. Self-reviewing to test on EB.

This reminds me that we should probably have a dev instance for deployment testing...