Open Wauplin opened 1 week ago
The InferenceClient supports many tasks in addition to chat completion. Would be nice to support this client and its async version AsyncInferenceClient.
AsyncInferenceClient
List of supported tasks: https://huggingface.co/docs/huggingface_hub/guides/inference#supported-tasks.
Not all tasks have to be implemented in the same PR :)
Please let me know if you have any question.
The InferenceClient supports many tasks in addition to chat completion. Would be nice to support this client and its async version
AsyncInferenceClient.List of supported tasks: https://huggingface.co/docs/huggingface_hub/guides/inference#supported-tasks.
Not all tasks have to be implemented in the same PR :)
Please let me know if you have any question.