allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.61k stars 651 forks source link

Jfrog Artifactory Storage Option #940

Open lambders opened 1 year ago

lambders commented 1 year ago

Proposal Summary

Do you have plans to support Jfrog artifactory as a storage option? https://clear.ml/docs/latest/docs/integrations/storage/

Motivation

Setting Artifactory as the ClearML storage backend could be useful for a lot of different ML workflows.

Related Discussion

N/A

thepycoder commented 1 year ago

Hi @lambders !

We are currently talking to the folks over at JFrog as we speak :) We were planning on releasing a tutorial on what a possible workflow using the artifactory (and the vulnerability scanner) would look like. However, this is more of a guide using both tools as they are now.

Just to understand better what you are asking for, are you thinking of e.g. storing models and data on JFrog through ClearML? In that case, which one of the 2 would be the source of truth for versioning? It's an interesting question and I'd love to hear more of your take on it :)