-
I have successfully gguf-converted the [base](https://huggingface.co/maddes8cht/adept-persimmon-8b-base-gguf) and [chat](https://huggingface.co/maddes8cht/adept-persimmon-8b-chat-gguf) variants of th…
-
By following the official docs to [setup the vLLM for cu118 through pip](https://docs.vllm.ai/en/latest/getting_started/installation.html#install-with-pip), leads to following error with respect to xF…
skt7 updated
8 months ago
-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
PyTorch version: 2.2.1+cu118
Is debug build: False
CUDA used to build PyTorch: 11…
-
I am a noob. Can you describe how I can fine-tune it with your program? It is possible? Maybe some articles.
n0r8 updated
6 months ago
-
**Describe the bug**
Training Baichuan13B model failed on Huawei platform, using Deepspeed Stage 3 with CPU offload.
**To Reproduce**
Steps to reproduce the behavior:
1. clone this repo: https:/…
-
**Describe the bug**
Hi, everybody, I'm traning a llama model in step3 using deepspeed-chat. In version 0.10.1, it raised the following error([see in logs bleow](https://github.com/microsoft/DeepSp…
-
### What happened?
*** mlir._mlir_libs._site_initialize..MLIRError: Unable to parse module assembly:
error: "-":3:10: Dialect `stablehlo' not found for custom op 'stablehlo.dot_general'
note: "…
-
When trying the `gguf` example, I get:
```
ERROR: Could not find a version that satisfies the requirement mlx>=0.0.11 (from versions: 0.0.4.dev20231210, 0.0.4, 0.0.5.dev20231217, 0.0.5, 0.0.6.dev2…
-
An error occurred while quantifying the bf16 model:
tensorrt_llm_0.5.0/examples/gpt/weight.py:265
```python
elif use_weight_only:
processed_torch_weights, torch_weight_scales …
-
Attempted Immich `v1.94.1` to `v1.97.0` with cloudnative-pg operator with postgres: `ghcr.io/tensorchord/cloudnative-pgvecto.rs:16.2-v0.2.0`, having similar issue as
Upgrade instructions fail at t…