-
When going through this tutorial: https://docs.coreweave.com/compass/examples/triton-inference-server-fastertransformer
At this step
```
kubectl apply -f download-weights-job-gpt-neox.yml
```
…
-
`git bisect` points to https://github.com/jart/cosmopolitan/commit/5b908bc7564397eadd3dda39900b4f32ce9968ed as the first bad commit.
The log around the error:
``` sh
# ./build/bootstrap/make.co…
-
Can a converter for GPT NeoX 20B be written to convert from PyTorch to Triton format?
-
**Describe the bug**
Hello, I found distributed training with the setting `"model-parallel-size": >1` hangs. This situation appears in the source with the PR #958 is merged, and it did not appear in …
-
### System Info
```Shell
- `Accelerate` version: 0.15.0
- Platform: Linux-4.19.0-22-cloud-amd64-x86_64-with-glibc2.35
- Python version: 3.10.6
- Numpy version: 1.23.5
- PyTorch version (GPU?): 1.…
-
Getting the following error after executing "./pre-commit.sh"
```
(decoding_trust_env) skrishna helm % mypy --install-types --non-interactive src scripts
Installing missing stub packages:
/Users…
-
### System Info
Python 3.7.13
transformers 4.22.2
### Who can help?
@LysandreJik @patrickvonplaten
### Information
- [X] The official example scripts
- [X] My own modified scripts
### Tasks
- …
-
**LocalAI version:**
`quay.io/go-skynet/local-ai:master-cublas-cuda12-core`
**Environment, CPU architecture, OS, and Version:**
`Linux user-Z68X-UD3P-B3 6.2.0-39-generic #40~22.04.1-Ubunt…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
hksk updated
10 months ago
-
**LocalAI version:**
`quay.io/go-skynet/local-ai:v1.22.0-cublas-cuda11`
**Environment, CPU architecture, OS, and Version:**
`Linux glados 6.2.0-26-generic #26-Ubuntu SMP PREEMPT_DYNAMIC Mon…