openshift-psap / topsail

Test Orchestrator for Performance and Scalability of AI pLatforms
Apache License 2.0
11 stars 16 forks source link

[fine-tuning] Allow downloading models from IBM DMF datalake #538

Closed kpouget closed 1 month ago

openshift-ci[bot] commented 1 month ago

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please ask for approval from kpouget. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files: - **[OWNERS](https://github.com/openshift-psap/topsail/blob/main/OWNERS)** Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
kpouget commented 1 month ago

@albertoperdomo2 , can you please try this PR and see if it works as expected? the download is progressing on the DGX, maybe you can launch it on the IBM cluster and confirm that the model is downloaded?

I'll integrate it in the orchestration when I have a bit of time