Markdown format is not returned

Strvm / meta-ai-api

Llama 3 API 70B & 405B (MetaAI Reverse Engineered)

267 stars 50 forks source link

Closed tqdo closed 1 week ago

tqdo commented 1 month ago

I notice that when streaming=True, initially the markdown is accurate but after a while the markdown syntaxes just disappeared. Is it a bug?

Screenshot 2024-10-07 at 7 33 38 AM

Strvm commented 1 week ago

Hi, I just return what FB returns. Might need to do extra formatting on the output