-
### 起始日期 | Start Date
9/3/2024
### 实现PR | Implementation PR
_No response_
### 相关Issues | Reference Issues
_No response_
### 摘要 | Summary
When using vLLM to optimally utilize GPU space for faste…
-
**Is your feature request related to a problem? Please describe.**
my truly minimal use case request: I have 2 datasets with resolutions 256 and 512, I want to build 2 dataloaders, one dataloader loa…
-
The multiVi fails at the `mvi.train` in `batch_correct_multivi.py`.
```
Traceback (most recent call last):
File "[path]/panpipes/panpipes/python_scripts/batch_correct_multivi.py", line 256, in …
-
Trying to run offline retinanet in a container with one Nvidia GPU:
cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1-dev --model=retinanet --implementation=nvidia …
-
Thank you very much for your open source contribution, which is very helpful for my current work!
But I encountered some problems. In version 1.2, when inferring the 93x480p version with an A800 80G …
-
Dear all,
I am currently learning Bayesian analysis and utilizing `tensorflow_probability.substrates.jax`, but I've encountered some issues. While using `jax` with `jit` for NUTS alone, the perform…
-
Hi, I'd like to know how much memory is required for ThemeStation? An A100 or just RTX3090 with 24GB will be enough?
-
Hi, I am currently exploring the potential of leveraging Intel GPUs for fine-tuning using Unsloth with [Intel's extension for PyTorch](https://github.com/intel/intel-extension-for-pytorch).
**Objec…
-
### What problem are you trying to solve? Do you a suggestion on how to solve it?
We propose implementing a GPU usage monitor within Aptakube for Kubernetes environments. This feature would provide r…
-
i use huggingface trl sfttrainer and peft and deepspeed to train a 6B model.
i have a 4 12GB gpu.
when i use automodel.from_pretrained(device_map="auto"), it works. but the training process is so…