Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, GraphRAG, DeepSpeed, Axolotl, etc
ipex 2.3 will replace some transformers's functions, which may cause error
insert a fake module before importing ipex to avoid it
1. Why the change?
2. User API changes
3. Summary of the change
4. How to test?
[ ] N/A
[ ] Unit test: Please manually trigger the PR Validation here by inputting the PR number (e.g., 1234). And paste your action link here once it has been successfully finished.
MeouSker77
commented
2 weeks ago
Description
ipex 2.3 will replace some
transformers's functions, which may cause errorinsert a fake module before importing ipex to avoid it
1. Why the change?
2. User API changes
3. Summary of the change
4. How to test?
1234). And paste your action link here once it has been successfully finished.