Missing section about ML Monitoring

[santiviquez]

Sub-section title

Monitoring ML Models

Please describe your issue

I think the current topic list is missing a section on ML monitoring. It can be about techniques and algorithms to monitor language and vision models.

Describe the solution you'd like to see

I would like the section to touch on points like:

• Model performance estimation for language and vision models.
• Monitoring estimated and realized performance of AI models.
• How to detect data drift in language and vision models.
• Issue resolution techniques to address model failures.

[skyfallsin]

@santiviquez is this something you can start a python notebook for if this is your area of expertise?

[santiviquez]

Hi @skyfallsin, yes, I can provide a Python notebook with examples for each of those points. Are there any specific guidelines for the notebook?

[skyfallsin]

@santiviquez preferably we'd like to see it in a way that runs in a free Colab instance.