-
Hi,
I've been trying to setup unsloth on WSL2 with the simple command
`pip install "unsloth[cu121-torch211] @ git+https://github.com/unslothai/unsloth.git"`
It seems to be creating about 30+ GB…
-
### Environment
```text
(aws_neuronx_venv_transformers_neuronx) ubuntu@ip-172:~/vllm$ python --version
Python 3.10.12
(aws_neuronx_venv_transformers_neuronx) ubuntu@ip-172:~/vllm$ pip list | grep …
-
我的需求是希望能够做专用的小模型（纯个人使用），但小模型需要具备基本的逻辑能力，并且个人没太多资源，顶多两张4090。
所以，我想通过看看是否能够通过蒸馏的方法解决这个需求。
这是一篇将transformers架构通过蒸馏的方法转换为ssm
[Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mo…
-
# URL
- https://arxiv.org/abs/2406.15786
# Affiliations
- Shwai He, N/A
- Guoheng Sun, N/A
- Zheyu Shen, N/A
- Ang Li, N/A
# Abstract
- While scaling Transformer-based large language models …
-
> Hugging Face Transformers is an open-source framework for deep learning created by Hugging Face. It provides APIs and tools to download state-of-the-art pre-trained models and further tune them to m…
-
## Resource
- examples: https://github.com/pytorch/examples, the fork: https://github.com/cosdt/pytorch-examples/tree/npu
- benchmark: https://github.com/pytorch/benchmark, models: https://github.…
shink updated
23 hours ago
-
Hi all, just a heads up: I filed an [issue](https://github.com/huggingface/transformers/issues/29466) with `huggingface/transformers` requesting model support for BASED via their library.
My engage…
-
# ComfyUI Error Report
## Error Details
- **Node Type:** Joy_caption_two_load
- **Exception Type:** RuntimeError
- **Exception Message:** Failed to import transformers.models.siglip.modeling_sigli…
-
Hello, I'm trying ipex-llm 2.2.0b20240927 with pytorch ipex 2.3.110+xpu, and it failed with following error:
```
ERROR azarrot.backends.common:common.py:323 An error occurred when generating te…
-
ValueError: You are trying to return timestamps, but the generation config is not properly set. Make sure to initialize the generation config with the correct attributes that are needed such as `no_ti…