HuggingFace Serverless Inference API

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

https://docs.continue.dev/

Apache License 2.0

19.52k stars 1.69k forks source link

HuggingFace Serverless Inference API #2122

Open debjan opened 2 months ago

debjan commented 2 months ago

Validations

[X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
[X] I'm not able to find an open issue that requests the same enhancement

Problem

Hi, can HuggingFace Inference be set with "Serverless Inference API" instead "Inference Endpoint"?

Solution

No response

sestinj commented 2 months ago

I agree, this would be nice! Linking to the docs here in case anyone is interested in contributing. Not otherwise a top priority at least at the very moment