-
Hey guys, I'm trying to run the `gradio_demo.py` and `demo.ipynb` locally and it looks like the repository that the demo code relies on is no longer available.
Can you please fix this? Or let me know…
-
Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model on the CPU or the disk while keeping these modules i…
-
作者你好,我在用qwen2-1.5b模型的时候,量化成功,但是跑出来结果不对,请问量化参数如何配置呢?
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A…
-
Hi Team,
When I am loading the Mixtral-based SFT MoE model 'DAMO-NLP-SG/VideoLLaMA2-8x7B' using the same inference code provided in the README.md, the following error is raised:
```
Traceback (…
-
### System Info
```
- `transformers` version: 4.45.1
- Platform: Linux-5.10.0-33-cloud-amd64-x86_64-with-glibc2.35
- Python version: 3.11.10
- Huggingface_hub version: 0.26.0
- Safetensors ver…
-
### System Info
irrelevant, happens on any env with updated transformers, replicated myself on `Transformers v4.46.0` (current release on pip at time of writing)
### Who can help?
@amyerobert…
-
Currently I need to load a tokenizer from HuggingFace, and use it for simply encoding and decoding sentences. While doing that from Transformers.jl interface is awkward already (I had to go `tok = Tra…
-
**Doc request**
Substitute mentions of `tokenizer.lang_code_to_id` from `NLLB` documentation.
**Additional context**
huggingface/transformers#29834 removed `lang_code_to_id` from `NLLBTokenizer…
sotwi updated
3 months ago
-
### 向量数据库(Vector Database)
#### 简介
**向量数据库**是一种专门用于存储、查询和管理高维向量数据的数据库系统。向量数据库可以高效处理**向量搜索**、**相似性检索**和**机器学习模型输出的特征向量**。它的核心目标是解决如何在海量的向量数据中,快速找到与给定向量最相似的数据。
#### 向量是什么?
向量(Vector)在计算中通常指的是一…