Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, GraphRAG, DeepSpeed, Axolotl, etc
Description
Add
fused_mlpto glm4v modelshttps://github.com/analytics-zoo/nano/issues/1728#issuecomment-2467489682
PR validation: https://github.com/intel-analytics/ipex-llm-workflow/actions/runs/11774614223