search

huggingface / huggingface_hub

The official Python client for the Huggingface Hub.
https://huggingface.co/docs/huggingface_hub
Apache License 2.0
1.82k stars 470 forks source link

hardware args in docs for creating inference endpoints are outdated #2339

Closed MoritzLaurer closed 2 weeks ago

MoritzLaurer commented 2 weeks ago

The arguments in the docs for creating inference endpoints still follow the old naming convention: 

    instance_size="medium",
    instance_type="g5.2xlarge",

The correct new argument values are here: https://huggingface.co/docs/inference-endpoints/pricing E.g.:

    instance_size="x1",
    instance_type="nvidia-a10g
Wauplin commented 2 weeks ago

Thanks for reporting @MoritzLaurer! This has been fixed by @co42 in https://github.com/huggingface/huggingface_hub/pull/2282. Docs from main have been updated (see https://huggingface.co/docs/huggingface_hub/main/en/package_reference/hf_api#huggingface_hub.HfApi.create_inference_endpoint) but it has not been officially released yet.