How to quantize this sql coder 7b_2 model? any resources? - Githubissues

defog-ai / sqlcoder

SoTA LLM for converting natural language questions to SQL queries

Apache License 2.0

3.41k stars 218 forks source link

How to quantize this sql coder 7b_2 model? any resources? #119

Closed Arslan-Mehmood1 closed 1 month ago

Arslan-Mehmood1 commented 2 months ago

How to quantize this sql coder 7b_2 model? any resources?

is there any quanitzed version available? and is the sqlcoder-7b-q5_k_m.gguf a quantized version?

github-actions[bot] commented 1 month ago

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] commented 1 month ago

This issue was closed because it has been inactive for 14 days since being marked as stale.