search

defog-ai / sqlcoder

SoTA LLM for converting natural language questions to SQL queries
Apache License 2.0
3.41k stars 218 forks source link

are sqlcoder models supported by vllm? #103

Closed Mrs-Hudson closed 5 months ago

Mrs-Hudson commented 6 months ago

Is the sqlcoder model architecture supported by vllm? https://docs.vllm.ai/en/latest/models/supported_models.html

for sql coder 7B the architecture is AutoModelForCausalLM which isn't listed in the doc above.

kkkawhi2 commented 6 months ago

all hg models can

github-actions[bot] commented 5 months ago

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] commented 5 months ago

This issue was closed because it has been inactive for 14 days since being marked as stale.