Umbrella Issue for Orca Ray pipeline

intel-analytics / ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, GraphRAG, DeepSpeed, Axolotl, etc

Apache License 2.0

6.76k stars 1.27k forks source link

1. Modeling with Ray and processing data with PySpark

orca function + ray application with orca RayOnSpark

[ ] #4194

2. Modeling with Orca Estimator and processing data with Ray

ray dataset + orca estimator

[x] #4185
[ ] #4186

3. Modeling with Orca Estimator and feeding model with data iterator (Pytorch DataLoader/TF Dataset)

data creator + orca estimator

[ ] #4187
[ ] #4188

4. Modeling with Orca Estimator and processing data with native python code

RayXShards + orca estimator

[ ] #4189
[ ] #4191
[ ] #4192

intel-analytics / ipex-llm