-
The title explains
https://huggingface.co/stabilityai/stablelm-zephyr-3b
-
### Your current environment
- vLLM CPU v0.5.3.post1
- Model: stabilityai/stablelm-3b-4e1t
- Dtype: FP16 or BF16
- AMD EPYC - 32 Core Processor
- RAM: 100 GB
### 🐛 Describe the bug
vLLM CPU v…
-
-
### Your current environment
```text
Can't run since running on dockerized cluster. Using latest pip install for both vLLM and transformers + CUDA 12.1
```
### 🐛 Describe the bug
Running …
-
Hello, @YTianZHU . I read the Differential Transformer paper and found it very interesting.
Thank you so much for your work.
I was wondering how you visualized the attention scores in Figure 1:
，您会接受吗？🙇🏽
-
Is it possible to get embeddings from the model for my input text?
I.e. could I replace GTP3 calls from OpenAI with some python code and this model?