-
I'm currently testing Llama2 70B on DGX-A100 and DGX-H100. I'm running the gptManagerBenchmark as described [here](https://github.com/NVIDIA/TensorRT-LLM/tree/release/0.5.0/benchmarks/cpp) and compari…
jfolz updated
3 months ago
-
**base-model: Weyaxi/Dolphin2.1-OpenOrca-7B**
**Scenario:**
- followed the following guidelines - https://github.com/intel-analytics/ipex-llm/tree/main/python/llm/example/GPU/LLM-Finetuning/QLoRA…
-
Hello,
I have a bug when using models from the transformers package that automatically add special tokens in the tokenizer, for instance :
```python
lm = models.Transformers("Open-Orca/Mistral…
-
### Feature request
Now that the context window is variable (per #1668) it would be helpful to have models2.json updated to populate the n_ctx field along with the correct system and user prompts.
…
-
### Anything you want to discuss about vllm.
Here is my guided_json
`guided_json = {"type": "object",
"properties": {
"age": {"type": "string", "pattern": r"^Fifty"},…
-
I tried #26 and gguf model type didn't get picked up by llm until I registered a model with "llm llama-cpp add-model". I'm not sure if this is working as intended - I expected that gguf would appear …
-
### System Info
GPT4All 2.5.4 macOS 14.2.1 (23C71) M1 Macbook 16GB mem 2TB disk
### Information
- [X] The official example notebooks/scripts
- [ ] My own modified scripts
### Reproduction
I insta…
-
### System Info
GPT4All: 2.6.2-2
Python: 3.11.5
OS: Archlinux
Kernel: 6.7.3-arch1-2
### Information
- [X] The official example notebooks/scripts
- [ ] My own modified scripts
### Repro…
arael updated
7 months ago
-
hi, how to resolve the problem? directory ‘static/’ does not exist. thanks!
-
Lots of multilingual datasets listed here https://docs.google.com/spreadsheets/d/1qf0iYejG-9RgEEi13qB_SK_178-eNaeJDmSDNSj260A/edit?gid=1875159366#gid=1875159366 from https://blog.voyageai.com/2024/06/…