Improbable-AI / monkey-job-runner

Monkey Job Runner
2 stars 1 forks source link

[Monkey-Core] Store all data in local filesystem then copy to provider bucket #79

Open Averylamp opened 4 years ago

Averylamp commented 4 years ago

Will allow users to request run results without hitting s3 bucket latency all of the time

submit dataset/codebase -> localfs, localfs copies to provider bucket/mountfs continues run.

localfs will have all runs