-
The Chat models like [codellama-instruct](https://huggingface.co/codellama/CodeLlama-7b-Instruct-hf/blob/main/tokenizer_config.json), [qwen](https://modelscope.cn/models/qwen/Qwen1.5-14B-Chat/file/vie…
-
The puzzle `79-297c2dd6` from #79 has to be resolved:
https://github.com/h1alexbel/fakehub/blob/6932d8bc8d0c334bc7dba4106a820a77e305f622/server/src/routes/home.rs#L30-L33
The puzzle was created by …
0pdd updated
3 months ago
-
### What happened?
I'm trying to run llama-server using `./llama-server -m models/codellama-7b.Q4_K_M.gguf -c 2048` after building it. I'm getting an Illegal Instruction error message.
The illegal…
-
**First:**
I download the latest `tensorrtllm_backend` of main branch.
```
git clone -b main https://github.com/triton-inference-server/tensorrtllm_backend.git
```
**Second:**
I execute t…
-
Code Llama 70B now available
--
"We just released new versions of Code Llama, our LLM for code generation. Code Llama 70B consists of two new 70B parameter base models and one additional instruction…
-
Hello,
I am working on trying Java projects but facing a serious problem. I found that many LLMs (except OpenAI GPTs), especially open-source ones (including Llama 70b, Code Llama, etc.), as well a…
-
Hello!
I'm using CodeLlama-7b on Ubuntu 22.01, Visual Studio Code 1.86 or Ollama command line tool, HP ProBook 440 G6 with Intel® Core™ i3-8145U CPU @ 2.10GHz × 4, 16 GB memory and Mesa Intel® UHD …
-
Collect and list the options for open-source LLMs (Code Llama, Wizard Code, Deepseek Coder, Open Code Interpreter, etc.), ensuring their API formats to be OpenAI compatible which can be replaceable to…
-
I hope to see a tinyllama example included with a custom conversational dataset, particularly with Chat ML. Or how do I achieve this with the provided tinyllama "default" example? My goal is to demons…
-
While serving the CodeLLaMA 13B (`CodeLlama-13b-hf`) base model with `v1/completions` API with 1 A100, I encountered the following CUDA memory issue.
The same thing happened with the 34B base model, …