search

datarobot / datarobot-user-models

User's custom models boilerplate
Other
96 stars 85 forks source link

Prepare GPU envs for 10.2 release #1155

Closed elatt closed 2 weeks ago

elatt commented 2 weeks ago

This repository is public. Do not put here any private DataRobot or customer's data: code, datasets, model artifacts, .etc.

Summary

Rationale

With 10.2 wrapped, I'm preparing a release candidate build of the MLOps GPU envs. I think it is ok to make NIM env public because it requires an NGC key to use anyway and making it public will make it more discoverable. I also opted to remove the annotations from the generated requirements files because they were ending up in the version description of the UI and cluttering things.

elatt commented 2 weeks ago

Manually ran jenkins/test_functional_per_framework.sh {vllm, nim, triton}

engprod-2[bot] commented 2 weeks ago

The Needs Review labels were added based on the following file changes.

Team @datarobot/custom-models (#custom-models) was assigned because of changes in files:

public_dropin_gpu_environments/README.md
public_dropin_gpu_environments/__init__.py
public_dropin_gpu_environments/nim_llm/README.md
public_dropin_gpu_environments/nim_llm/dr_requirements.txt
public_dropin_gpu_environments/nim_llm/env_info.json
public_dropin_gpu_environments/triton_server/dr_requirements.txt
public_dropin_gpu_environments/triton_server/env_info.json
public_dropin_gpu_environments/vllm/dr_requirements.txt
public_dropin_gpu_environments/vllm/env_info.json

Team @datarobot/tracking-agent (#tracking-agent-reviews) was assigned because of changes in files:

public_dropin_gpu_environments/README.md
public_dropin_gpu_environments/__init__.py
public_dropin_gpu_environments/nim_llm/README.md
public_dropin_gpu_environments/nim_llm/dr_requirements.txt
public_dropin_gpu_environments/nim_llm/env_info.json
public_dropin_gpu_environments/triton_server/dr_requirements.txt
public_dropin_gpu_environments/triton_server/env_info.json
public_dropin_gpu_environments/vllm/dr_requirements.txt
public_dropin_gpu_environments/vllm/env_info.json

If you think that there are some issues with ownership, please discuss with C&A domain at #core-backend-domain slack channel and create PR to update DRCODEOWNERS\CODEOWNERS file.