search

Azure / azure-sdk-for-python

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://docs.microsoft.com/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.
MIT License
4.35k stars 2.7k forks source link

add the possibility to track metrics every few iterations/periods of time #36177

Open alissonycc opened 1 week ago

alissonycc commented 1 week ago

Is your feature request related to a problem? Please describe. When using the automl.text_classification() method to train an NLP task, I would like to track the log_loss over time to check how the model is effectively learning. I already tried different datasets with different search spaces, but the best chart I got had only 2 observations of my metrics. Is there a way that I can make Azure ML track the log_loss of my model every few seconds/minutes?

Describe the solution you'd like Add a parameter to the automl.text_classification()method so we can have the possibility to track metrics overtime, even for small datasets.

Describe alternatives you've considered None.

Additional context None

xiangyan99 commented 1 week ago

Thanks for reaching out.

Could you help to provide the information that: which Azure SDK do you use? Which version?

Thank you.

github-actions[bot] commented 1 week ago

Hi @alissonycc. Thank you for opening this issue and giving us the opportunity to assist. To help our team better understand your issue and the details of your scenario please provide a response to the question asked above or the information requested above. This will help us more accurately address your issue.

alissonycc commented 1 week ago

I am currently using azure-ai-ml==1.16.0

github-actions[bot] commented 4 days ago

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @Azure/azure-ml-sdk @azureml-github.