intel llm-on-ray issues

intel / llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray

Apache License 2.0

99 stars 28 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Bump langchain-community from 0.0.32 to 0.2.9 in /application

#279 dependabot[bot] opened 1 week ago
0
Bump langchain from 0.1.16 to 0.2.10 in /application

#278 dependabot[bot] opened 2 weeks ago
0
Add application name option for openai serve

#277 cheehook closed 1 month ago
1
Fix Dependabot alert 35

#276 carsonwang closed 1 month ago
0
Add new_deployment option for serve

#275 cheehook closed 1 month ago
1
fix openssf

#274 minmingzhu closed 1 month ago
0
Fix openssf

#273 minmingzhu closed 1 month ago
0
Vllm ns merged 209 7d49516

#272 jiafuzha closed 2 months ago
0
Bump torch from 1.13.1 to 2.2.0 in /llm_on_ray/pretrain

#271 dependabot[bot] closed 2 months ago
0
[Document] Add CI self-hosted workflow on CPU/Gaudi

#270 Deegue closed 1 month ago
0
[Inference] Add validated models for Gaudi

#269 Deegue closed 2 months ago
1
[Gaudi] Improve Gaudi workflow for self-hosted runner

#268 Deegue opened 2 months ago
6
Integrate vllm/ns into llm-on-ray

#267 jiafuzha opened 2 months ago
0
Test CI

#266 carsonwang closed 2 months ago
0
Fix fine-tuning bugs

#265 harborn opened 2 months ago
0
Integrate vllm and inference engine (neural speed)

#264 jiafuzha closed 2 months ago
5
[Inference]apt-get intel-oneapi-ccl-devel-2021.12 intel-oneapi-compiler-dpcpp-cpp-runtime-2024.1 to fix deepspeed inference error.

#263 minmingzhu closed 3 months ago
0
[Inference] Integrate vllm example

#262 KepingYan closed 1 month ago
2
[BUG] Fix ci inference deepspeed bug

#261 yutianchen666 closed 3 months ago
0
[BUG] Fix inference with deepspeed Error

#260 yutianchen666 closed 3 months ago
0
fixed benchmark error after removing HF token from build log

#259 jiafuzha closed 3 months ago
0
[Finetune] print metrics by rank0 for train and evaluation in fine-tuning

#258 harborn opened 3 months ago
0
[Inference] Add debug mode

#257 Deegue opened 3 months ago
1
Fix Bandit reported issue by using secrets to replace random

#256 carsonwang closed 3 months ago
0
AssertionError: BF16 weight prepack needs the cpu support avx512bw, avx512vl and avx512dq

#255 iodone closed 3 months ago
5
[BUG] Limit numpy<2.0.0 for realase 2.0.0 bug

#254 yutianchen666 closed 3 months ago
1
remove HF token from build log

#253 jiafuzha closed 3 months ago
5
[Finetune] Fix evaluation

#252 minmingzhu closed 3 months ago
0
Finetune on Ray cluster with trial task failed

#251 iodone closed 3 months ago
4
try to fix evaluation problem

#250 harborn opened 3 months ago
0
Inference Mixtral on Gaudi

#249 Deegue opened 3 months ago
3
Inference Qwen1.5-110b on Gaudi2

#248 Deegue closed 3 months ago
1
[Benchmark] Fix parameters mismatch

#247 KepingYan closed 3 months ago
0
[Finetune] WandB integration

#246 xwu99 closed 3 months ago
0
[Finetune] Fix fault-tolerant training

#245 xwu99 closed 3 months ago
0
[Infer] Add Simple Protocol for simple request and response

#244 yutianchen666 closed 3 months ago
0
Add Internal Server Error log output

#243 yutianchen666 closed 2 months ago
0
Finetuning on Ray and CPU causes Runtime error

#242 premdass opened 4 months ago
12
remove deltatuner

#241 harborn closed 4 months ago
0
[Finetune] Add finetune Gaudi workflow

#240 Deegue opened 4 months ago
0
fix a bug of fine-tuning on HPU

#239 harborn closed 4 months ago
0
[Finetune] Integrate DPO trainer for CPU and Gaudi

#238 minmingzhu opened 4 months ago
0
Fix vllm hpu version

#237 KepingYan closed 4 months ago
0
Add callbacks to the Trainer

#236 xwu99 opened 4 months ago
0
Fix bug: HPU generates unrelated content after eos

#235 kira-lin closed 4 months ago
1
A question about finetune dataset processing

#234 KepingYan opened 4 months ago
1
[Refactor] Remove dataset/tokenizer/model packaging under common, make pretrain/finetune scripts without common dependency.

#233 harborn closed 4 months ago
0
[Inference] Enable vllm on HPU

#232 KepingYan closed 4 months ago
0
Integrate vllm and inference engine (neural speed)

#231 jiafuzha closed 3 months ago
2
[CI] Change miniconda to miniforge

#230 yutianchen666 closed 4 months ago
0