Open geffzhang opened 6 months ago
This is written in Python, can C++ be added as well? Python's performance is not satisfactory.
This is written in Python, can C++ be added as well? Python's performance is not satisfactory.
Unfortunately there is no such plan at this moment
Using bigdl-llm in a production environment, Python performance is too poor, can you provide an inference library in C++ and provide an OpenAI-compatible API