-
This question is related to https://github.com/apache/tvm/pull/15487
I tried to embed AMD's **attention** operator directly in the llama model. The model could be compiled normally, but I encounter…
-
Das Skript sollte als Input eine Liste von zu überprüfenden DOIs bekommen und dann nach folgenden Regeln Dokumente entfernen.
- es muss mindestens zwei Dokumente mit der gleichen DOI geben
- bei m…
-
Hey,
I'm trying to compile a `dsp` program where large text samples are being used in `trainset`.
```
llm= dspy.HFModel(model = model_name)
dspy.settings.configure(lm=llm)
```
```
class Cat…
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused b…
-
I'm trying to run the model on a Jupyter Notebook but I'm not sure how to go by this. Is anyone working on this? I would really appreciate some tips.
(P.S I'm a TensorFlow developer and trying to r…
-
Neue Überlegung, die im nächsten Meeting besprochen werden soll:
Zss, die laut Zeder **tiefp=J** sind sollen ein neues Abrufzeichen (8012) **tiep** erhalten.
Dies soll die Nachbearbeitung für di…
IxKo updated
12 months ago
-
Excellent work!
My device is 8*A100 80G and i want to expand the context window size to 32k. When i set it to 32k, batchsize to 1, the OOM error occurred. I'm wondering if it will work if i add num…
-
Dear all,
I am trying to run `stabilityai/FreeWilly2` (LLaMA 2 70B) model. When I run any request to the model I have:
```
/home/sergeys/miniconda3/lib/python3.9/site-packages/transformers…
-
**Describe the bug**
optimum-intel cli converted openvino ir models does not load on the model-server
**To Reproduce**
```
$ uname -r
5.15.0-92-generic
$ cat /etc/os-release
PRETTY_NAME="Ub…
-
Hi , I try deploy llama2 today , and found the issue :
(llama) [root@iZbp1iobggdz6jrvvlgpx4Z llama]# torchrun --nproc_per_node 1 example_text_completion.py \ --ckpt_dir llama-2-7b/ \ --token…