huggingface / huggingface_hub

The official Python client for the Huggingface Hub.
https://huggingface.co/docs/huggingface_hub
Apache License 2.0
2.02k stars 531 forks source link

[Feature request] Set environment variable in inference endpoint (custom docker image) #2301

Closed datavistics closed 4 months ago

datavistics commented 4 months ago

Save me @Wauplin, you are my only hope.

create_inference_endpoint and update_inference_endpoint do not set the image the same way

I want to be able to update the env var in a deployed inference endpoint. Currently I can only delete and re-create.

Wauplin commented 4 months ago

Your hope is there: https://github.com/huggingface/huggingface_hub/pull/2306.

Wauplin commented 4 months ago

Save me @Wauplin

@davanstrien Done.