missing dependencies

[VincyZhang]

Describe the issue When I use pip install intel-extension-for-transformers in a fresh conda environment, there are some packages missing that I have to manually install before I can run a model.

Please add these to setup.py as deps!

• accelerate
• neural-speed
• gguf
• there may be others, I installed some other things before I started writing these down

To reproduce, simply:

• conda create -n itrex python=3.9
• pip install intel-extension-for-transformers
• Run the following 3-line python script:

from intel_extension_for_transformers.transformers import AutoModelForCausalLM

model_name = "meta-llama/Llama-2-7b-hf"

model = AutoModelForCausalLM.from_pretrained(model_name, load_in_4bit=True)

[NeuralChatBot]

The issue you're experiencing is due to the fact that the intel-extension-for-transformers package is not properly handling the installation of its dependencies. It seems like the package is missing some crucial dependencies that are required for it to function properly.

To resolve this issue, you should manually install these dependencies before installing the intel-extension-for-transformers package. Here's how you can do it:

pip install accelerate
pip install neural-speed
pip install gguf

After you've installed these dependencies, you should be able to install the intel-extension-for-transformers package without any issues:

pip install intel-extension-for-transformers

If you're using conda, you can create a new environment and install the dependencies and the intel-extension-for-transformers package in that environment:

conda create -n itrex python=3.9
conda activate itrex
pip install accelerate
pip install neural-speed
pip install gguf
pip install intel-extension-for-transformers

This should resolve the issue you're experiencing. If you have any other questions, feel free to ask.

If you need help, please @NeuralChatBot

[VincyZhang]

@NeuralChatBot

[VincyZhang]

@NeuralChatBot