search

lyogavin / airllm

AirLLM 70B inference with single 4GB GPU
Apache License 2.0
4.01k stars 332 forks source link

Does Airllm support sqlcoder-34b which was fine-tuned on codellama? #85

Closed mw-hv closed 8 months ago

mw-hv commented 8 months ago

I wonder if Airllm supports sqlcoder-34b which was fine-tuned on codellama? Thanks

here is the link to the model repo https://huggingface.co/defog/sqlcoder-34b-alpha

lyogavin commented 8 months ago

Yes. It's a standard LLama architecure. It should work out-of-box.