search

aws / sagemaker-experiments

Experiment tracking and metric logging for Amazon SageMaker notebooks and model training.
Apache License 2.0
125 stars 36 forks source link

Why is sagemaker-experiments not included in all SageMaker Studio images? #150

Open peter-wimsey opened 2 years ago

peter-wimsey commented 2 years ago

Hi there,

Apologies if this is not the right place to ask.

I am reading up on experiments in SageMaker and am a bit confused about the role of this library. Will it be merged into the generic sagemaker library as mentioned elsewhere? Am I supposed to use the UI-based tools in SageMaker Studio instead?

The library is not included in the "Data Science" image but is included in the "Pytorch 1.8 CPU" image. Have not tried the others.

Thanks

danabens commented 2 years ago

the role of this library

At a high level this library provides abstractions around SageMaker's experiment management APIs to create, read, update, list, delete Experiments, Trials, and Trial Components. Another major component of this library is the Tracker class which has methods for logging artifacts and metrics from your training scripts.

Will it be merged into the generic sagemaker library

That is the direction we are headed. Fewer packages/dependencies to manage for SageMaker functionality.

Am I supposed to use the UI-based tools in SageMaker Studio

The SageMaker Studio UI is intended to be used for training analysis and experiment tracking. i.e. you can compare multiple training runs visually with charts, graphs, and artifacts.

The library is not included in the "Data Science" image

Will investigate, thanks for pointing this out.