search

intel / llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray
Apache License 2.0
99 stars 28 forks source link

[Inference] Add debug mode #257

Open Deegue opened 3 months ago

Deegue commented 3 months ago

Debug mode with logs and some improvements & questions.

xwu99 commented 3 months ago

@KepingYan could you help to review this and discuss with @Deegue