-
### Preliminary Checks
- [X] This issue is not a duplicate. Before opening a new issue, please search existing issues.
- [X] This issue is not a question, feature request, or anything other than a bu…
-
### What is the issue?
When i install ollama in my musl based [distro](kisslinux.github.io) it installs but cannot execute, i think is because the binarie is linked against glibc in system. Also ol…
-
(tensorflow_gpu_tar) C:\tensorflow1\models\research\object_detection>python train.py --logtostderr --train_dir=training/ --pipeline_config_path=training/faster_rcnn_inception_v2_pets.config
C:\Users\…
-
Is there any plan to incorporate GPU-based calculations to massively speed-up the simulation? This can be done for conflict-detection-resolution, propagating aircraft dynamics forward, or to allow for…
-
Hey I'm having trouble installing the docker GPU image. I tried it yesterday and it was fine, but I had to re-install due to some compatibility errors with Obsidian. Today, it won't install at all... …
-
### System Info
```shell
python: 3.11
OS: Linux
torch: 2.4.0
optimum: 1.21.3
onnx: 1.16.2
onnxruntime: 1.18.1
onnxruntime-gpu: 1.19.0
```
### Who can help?
@JingyaHuang @echarlaix
### Info…
-
## Goal
- Cortex can generate a model compatibility prediction, based on user's hardware and `model.yaml`
- This should be an API that Jan can call (potentially as part of `GET /models` and `GET /mod…
-
Here is my config:
![image](https://github.com/user-attachments/assets/0a370649-d753-470e-bc46-c97c081fa9bc)
![image](https://github.com/user-attachments/assets/2790a1ba-09ee-4ecb-8cf8-afd09f70434…
-
from unsloth import FastLanguageModel
import torch
max_seq_length = 2048 # Choose any! We auto support RoPE Scaling internally!
dtype = None # None for auto detection. Float16 for Tesla T4, V100, B…
-
**To Reproduce**
Steps to reproduce the behavior:
1. Use an 2XL40s machine ( gx3-48x240x2l40s in IBM Cloud )
2. Use instructlab image : registry.stage.redhat.io/rhelai1/instructlab-nvidia-rhel9:1.2-17…
ktam3 updated
2 weeks ago