canonical / data-science-stack

Stack with machine learning tools needed for local development.
Apache License 2.0
8 stars 3 forks source link

Add integration test for `dss create` to check MLflow access #70

Open orfeas-k opened 2 months ago

orfeas-k commented 2 months ago

Why it needs to get done

This is needed in order to ensure that created pods can access MLflow. This was initially suggested here by @misohu in the dss create PR.

What needs to get done

Write an integration test which will create a notebook and then it will run the script to create experiement in MLflow. e.g.

import mlflow
c = mlflow.MlflowClient()  # You should not need to specify the tracking_uri - it should be populated automatically
print(c.tracking_uri)  # should print the in-cluster url for dss's mlflow
c.create_experiment("test-experiment")  # Should succeed

The idea is to create notebook and then run kubectl exec with that script. Or we could also execute a jupyter notebook from inside the pod (which could be git clone and run).

Something like this (from PR) could also be used to run command from the pod.

When is the task considered done

There is integration test checking MLflow access.

syncronize-issues-to-jira[bot] commented 2 months ago

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/KF-5568.

This message was autogenerated