search

flux-framework / flux-core

core services for the Flux resource management framework
GNU Lesser General Public License v3.0
167 stars 49 forks source link

sqlite database backend for completed (inactive) jobs #2455

Open garlick opened 4 years ago

garlick commented 4 years ago

Add a service that tracks job completion, and scoops up all data for the job from the KVS and archives it in a database such as sqlite. The service would watch the job state transition events. Data would remain in the KVS, but in the future could be purged based on some site policy.

A front end tool for querying this database would be provided.

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had activity for 365 days. It will be closed if no further activity occurs within 14 days. Thank you for your contributions.

grondo commented 3 years ago

This still might be a long term goal. As a point of interest I ran across the following

https://github.com/pmwkaa/engine.so