missing dependencies

[VincyZhang]

Describe the issue When I use pip install intel-extension-for-transformers in a fresh conda environment, there are some packages missing that I have to manually install before I can run a model.

Please add these to setup.py as deps!

• accelerate
• neural-speed
• gguf
• there may be others, I installed some other things before I started writing these down

To reproduce, simply:

• conda create -n itrex python=3.9
• pip install intel-extension-for-transformers
• Run the following 3-line python script:

from intel_extension_for_transformers.transformers import AutoModelForCausalLM

model_name = "meta-llama/Llama-2-7b-hf"

model = AutoModelForCausalLM.from_pretrained(model_name, load_in_4bit=True)

[NeuralChatBot]

The issue you're experiencing is due to the fact that the intel-extension-for-transformers package is not properly handling the installation of its dependencies. It seems that the package is not listing its dependencies in its setup.py file, which means that when you install it, it doesn't know what dependencies to install.

To fix this, you need to add the missing dependencies to the setup.py file. Here's how you can do it:

1. Open the setup.py file in the intel-extension-for-transformers package.
2. Look for the install_requires variable. This is where you should add the missing dependencies.
3. Add the missing dependencies to the install_requires list.

Here's an example of what the install_requires list might look like after adding the missing dependencies:

install_requires=[
    "accelerate",
    "neural-speed",
    "gguf",
    # other dependencies...
],

After you've made these changes, you should be able to install the intel-extension-for-transformers package and its dependencies using pip:

pip install intel-extension-for-transformers

This should install all the necessary dependencies for the package to work correctly.

Please note that this is a workaround and may not be the best solution. The package maintainers should consider adding the missing dependencies to the setup.py file.

If you need help, please @NeuralChatBot