hpcaitech / EnergonAI

Large-scale model inference.
Apache License 2.0
630 stars 90 forks source link

Where is InferenceEngine definition? #210

Open liujuncn opened 1 year ago

liujuncn commented 1 year ago

I can't find it in energonai/engine.py

"from energonai.engine import InferenceEngine"

Mado007 commented 1 year ago

After installing EnergonAI you should be able to import InferenceEngine from energonai.engine in your Python code

There are three ways to install EnergonAI :

  1. Install from PyPI using pip: pip install energonai
  2. Install from source by cloning the repository and running pip install . after installing the requirements:
    $ git clone git@github.com:hpcaitech/EnergonAI.git
    $ pip install -r requirements.txt
    $ pip install .
  3. Use Docker by pulling the latest image: docker pull hpcaitech/energon-ai:latest

I hope this helps!

wswszhys commented 1 year ago

I can't find it in energonai/engine.py

"from energonai.engine import InferenceEngine"

Me too.