-
Installing collected packages: pytz, mpmath, xxhash, urllib3, tzdata, tqdm, sympy, safetensors, regex, pyyaml, python-dateutil, pyarrow-hotfix, pyarrow, nvidia-nvtx-cu12, nvidia-nvjitlink-cu12, nvidia…
-
Could you please release the example script for Phi-2? Thanks.
-
I cannot use taskweaver on api hosted by oobabooga/text-generation-webui. However, it work with llama cpp model loader on oobabooga/text-generation-webui which I cannot use it well as AMD rocm 5.7 has…
-
### System Info
- `transformers` version: 4.35.2
- Platform: Linux-6.1.58+-x86_64-with-glibc2.35
- Python version: 3.10.12
- Huggingface_hub version: 0.20.3
- Safetensors version: 0.4.1
- Acce…
-
### System Info
tgi latest version
### Information
- [X] Docker
- [ ] The CLI directly
### Tasks
- [ ] An officially supported command
- [ ] My own modifications
### Reproduction
tgi can use tr…
-
### System Info
- transformers.__version__: '4.36.1'
- platform: macOS 14.2.1 (23C71)
- Python version: Python 3.11.6
### Who can help?
@ArthurZucker
### Information
- [ ] The official example …
-
# Prerequisites
Hi there,
I am finetuning the model `https://huggingface.co/jphme/em_german_7b_v01` using own data (I just replaced the questions and answers by dots to keep it short and simple). …
Lue-C updated
6 months ago
-
Hello, I have been trying to use VideoChatGPT for single video inference/video demo and am having diffulties getting set up. I have followed the installation setup as laid out by the readme, and have …
rjccv updated
8 months ago
-
【TensorRT LLM:】
1. use chatglm2-6b models
2. build.py --max_beam_width=4
3. run.py --num_beams=4
4. result has 4 outputs， and output[0] is not the best output
Output [Text 0 Beam 0]: xxxxx
O…
-
Hi, I am using 8*a100-80gb to lora-finetune Llama2-70b, the training and evaluation during epoch-1 went well, but went OOM when saving the peft model. The nightly version of pytorch is used.
The fo…