-
### What is the issue?
I fine-tuned a sqlcoder model and generated a model file. When I deployed it on Ollama, there was a problem. The model could not run and the size of the Ollama file was incorre…
-
你好,除了tabnine、codeium、copilot之外,目前还有deepseek-coder、codellama、qwen2.5-coder、sqlcoder、codegeex4、codegemma可以通过ollama以及各种OpenAI-API-compatible风格的平台部署。能否提供基于OpenAI-API-compatible或者Ollama的自动化补全呢?
现在找到相关的插…
-
### Describe the issue
model = ipex._optimize_transformers(model.eval(), dtype=torch.bfloat16, inplace=True)
![image](https://github.com/intel/intel-extension-for-pytorch/assets/52916011/8d2a7d0…
-
实测sqlcoder2(基于starcoder)模型的速度比vllm快,但是输出内容与原版模型相差甚远,是否完全是因为不支持beam search的问题?
-
Experimentation in progress
- NSQL, https://huggingface.co/NumbersStation/nsql-6B
dataset used:
![Screen Shot 2023-07-06 at 11 10 05 PM (1)](https://github.com/h2oai/sql-sidekick/assets/1318029/26b…
-
I'm using flash attn2 for GPTBigCodeModel model(defog/sqlcoder2) fintuning and inference.After training with lora,i encounter a error when doing inference:
![image](https://github.com/Dao-AILab/flash…
-
![snipaste_20240915_162308](https://github.com/user-attachments/assets/3db84f9d-6917-4106-a4f1-cdca77fd2b75)
-
$ cat test.csv | duckdb :memory: "COPY (SELECT * FROM read_csv('/dev/stdin')) TO '/dev/stdout' WITH (FORMAT 'csv', HEADER)"
- https://duckdb.org/docs/api/cli/overview.html#:~:text=Running%20SQL%20S…
-
这个使用什么模型,另外使用langchain的SQLDatabase要小心一点,每个表都会发3条数据,方便可以交流使用微调模型写sql
-
If the use of OpenAI is not possible due to privacy concerns, it would be beneficial to have the option to utilize a locally installed language model.
One possible solution is to allow for customiz…