-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
Hi there,
amazing work :)
I just encountered an error while trying to run the library on an Apple M3 Max. Below is a MWE to reproduce the error. The example itself doesn't make sense but at leas…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
**Is your feature request related to a problem? Please describe.**
**Describe the solution you'd like**
Today KAITO supports the popular huggingface runtime. We should support other runtime like…
-
**Describe the bug**
After some of the changes, phi3 sample with inference flag stopped to work
**Olive logs**
```
python phi3.py --target cpu --precision int4 --inference --prompt "Write a stor…
-
I am trying to finetune Llama 3.1 with below settings
Unsloth 2024.8: Fast Llama patching. Transformers = 4.44.2.
GPU: NVIDIA A10G. Max memory: 21.988 GB. Platform = Linux.
Pytorch: 2.1.0+cu118. CU…
-
### Jan version
0.5.3
### Describe the Bug
I imported many models and for some of them, they are failing to load if I selected my both graphic cards (RTX 3060 12Go).
If I unselect one of them, the…
-
### System Info
Kernel: 6.5.0-28-generic
Distributor ID: Ubuntu
Description: Ubuntu 22.04.4 LTS
Release: 22.04
Codename: jammy
GPU: Sapphire Pulse RX 7900 XTX
ROCm Version…
-
Steps to reproduce:
```
lms server start
lms load lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF --gpu max -y
lms create
```
answering as:
```
? Select a scaffold to use | Node.js with…
-
step1
pretrain_projector_image_encoder.sh
step2
pretrain_projector_video_encoder.sh
step3
finetune_dual_encoder.sh
step4
eval/vcgbench/inference/run_ddp_inference.sh
step5
eval/vcgbench/gpt_e…