When are you going to release tensorrt-llm image?

PolyAI-LDN / pheme

Creative Commons Attribution 4.0 International

244 stars 22 forks source link

Open AI-General opened 7 months ago

AI-General commented 7 months ago

The result of Tensorrt-llm is very amazing. If this is real, we streaming is not needed at all.