Any example for matplotlib figure as part of artifact?🤔[question]

determined-ai / determined

Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.

https://determined.ai

Apache License 2.0

2.99k stars 347 forks source link

Any example for matplotlib figure as part of artifact?🤔[question] #8350

Closed humbleearth closed 5 months ago

humbleearth commented 10 months ago

Describe your question

Hi, As part of a submitted experiment, I am using matplotlib to plot and show it. Does determined ai uses this information and put it in artifacts or checkpoints. If not by default, how do I include matplotlib pic as part of the experiement artifacts? Do you have any examples for same?

Also wanted to know apart from the default metrics, does determined allow any custom visualization or inclusion of any other chart types as part of the visualization dashboard?

Checklist

[X] Did you search the docs for a solution?
[X] Did you search github issues to find if somebody asked this question before?

ioga commented 10 months ago

We have a few ways to add arbitrary files to checkpoints depending on which API you use.

Core API v1 or v2: https://docs.determined.ai/latest/model-dev-guide/api-guides/apis-howto/api-core-ug.html#step-3-1-save-checkpoints

PyTorchTrial: https://docs.determined.ai/latest/reference/training/api-pytorch-reference.html#determined.pytorch.PyTorchCallback.on_checkpoint_write_end

TFKerasTrial: https://docs.determined.ai/latest/reference/training/api-keras-reference.html#determined.keras.callbacks.Callback.on_checkpoint_end

Also wanted to know apart from the default metrics, does determined allow any custom visualization or inclusion of any other chart types as part of the visualization dashboard?

Not at this time, but it's on the roadmap.