missing dependencies

[VincyZhang]

Describe the issue When I use pip install intel-extension-for-transformers in a fresh conda environment, there are some packages missing that I have to manually install before I can run a model.

Please add these to setup.py as deps!

• accelerate
• neural-speed
• gguf
• there may be others, I installed some other things before I started writing these down

To reproduce, simply:

• conda create -n itrex python=3.9
• pip install intel-extension-for-transformers
• Run the following 3-line python script:

from intel_extension_for_transformers.transformers import AutoModelForCausalLM

model_name = "meta-llama/Llama-2-7b-hf"

model = AutoModelForCausalLM.from_pretrained(model_name, load_in_4bit=True)

[VincyZhang]

@NeuralChatBot

[NeuralChatBot]

The issue you're experiencing is due to the fact that the intel-extension-for-transformers package is not properly handling the installation of its dependencies. It seems like the package is missing some crucial dependencies that are required for it to function properly.

To resolve this, you can manually install these dependencies before installing intel-extension-for-transformers. Here's how you can do it:

pip install accelerate
pip install neural-speed
pip install gguf

After you've installed these dependencies, you should be able to install intel-extension-for-transformers without any issues:

pip install intel-extension-for-transformers

If you want to automate this process, you can add these lines to your setup.py file:

setup(
    #... other parameters...
    install_requires=[
        'accelerate',
        'neural-speed',
        'gguf',
        #... other dependencies...
    ],
)

This way, when someone installs your package using pip install, they'll get the necessary dependencies as well.

Please note that the exact dependencies you need may vary depending on the specifics of your project and the version of intel-extension-for-transformers you're using. Therefore, you may need to adjust the list of dependencies according to your needs.