search

aws / sagemaker-experiments

Experiment tracking and metric logging for Amazon SageMaker notebooks and model training.
Apache License 2.0
125 stars 36 forks source link

Tracking Non SageMaker Workload #142

Open yapnel opened 2 years ago

yapnel commented 2 years ago

Is it possible to use this SDK to track experiments that are not done in SageMaker? Basically, I am performing experiments in pure python on EC2 and I want to use this SDK to track the experiments. If possible, are there examples please?

Thanks

alar0330 commented 2 years ago

Yes, it is possible. As of today, the SM Experiments API has been opened for all tracking options but _logmetrics.

lorenzwalthert commented 2 years ago

Cool. How is this documented? Where can I learn about these things? I tried https://aws.amazon.com/blogs/aws/category/artificial-intelligence/sagemaker/ or watching this GitHub repo for releases (but there were none recently).

yapnel commented 9 months ago

Hi - could somebody please point me to the documentation where I can achieve this? @danabens

lorenzwalthert commented 9 months ago

I’d start here. https://aws.amazon.com/blogs/machine-learning/next-generation-amazon-sagemaker-experiments-organize-track-and-compare-your-machine-learning-trainings-at-scale/

yapnel commented 9 months ago

Thanks @lorenzwalthert

Just to confirm my understand from the blog, I am able to use the SDK to call the Run class to log any experiments i'm executing locally on my laptop via an IDE. Is that correct?