-
### Project to be claimed
`energon`: https://pypi.org/project/energon
### Your PyPI username
`philipp-fischer`: https://pypi.org/user/philipp-fischer
### Reasons for the request
The project has b…
-
Does it Energon-AI support this project for inference optimization?
-
A request from the Discord is to have the EE images available; specifically Start Your Engines.
-
to my understanding, the energon compatible format needs everything in the same folder like this
```
shard_000.tar
├── samples/sample_0000.jpg
├── samples/sample_0000.txt
├── samples/sample_0000.json
…
-
### 📚 The doc issue
In the Inference (Energon-AI) [Demo](https://github.com/hpcaitech/ColossalAI#GPT-3-Inference), what is the hardware used in th Energon-AI inference acceleration ? Can you show…
-
### 📚 The doc issue
I trained my model using gpt in the example, but I don't know how to infer. I tried built my model like train_gpt.py and the checkpoint was loaded, but the model's "generate()" me…
-
-
**Infomation**
V100
CUDA 11.3
transformers==4.23.1
torch==1.12.0
colossalai==0.2.5
energonai==0.0.1+torch1.12cu11.3
running for bloom-560m & bloom-7b1
**Question**
When I try to start the bl…
-
Hello, just wanted to report a frustrating issue I've encountered with COFH core (In other words: that mod that Thermal Expansion requires) and the Ground-bridge. So I was installing COFH core to fix …
-
I can't find it in energonai/engine.py
"from energonai.engine import InferenceEngine"