Return extraction progress in AP /status call

xtracthub / xtract-service

Globus Labs Xtract: Extract metadata from distributed data sets.

6 stars 1 forks source link

Return extraction progress in AP /status call #27

Open jgaff opened 4 years ago

jgaff commented 4 years ago

It looks like the progress of an extraction task isn't returned from the Action Provider /status call. Having information like the number of groups/families extracted out of the total allows users to see that the extraction is ongoing, and also estimate how long the process may take, and also allows for some basic sanity-checking. Can this be added somewhat easily?

tskluzac commented 4 years ago

Yes, we have that information available from the crawler so wouldn't be too hard to update the extraction service itself to do the same. I'll see what that would entail and outline it here.