FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.
Apache License 2.0
9.22k stars 549 forks source link

Add __init__.py #16

Closed shughes-uk closed 1 year ago

shughes-uk commented 1 year ago

The lack of __init__.py causes python setup.py bdist_wheel to incorrectly not include any of the python files in the resulting wheel. This fixes that!