search

FreedomIntelligence / AceGPT

Apache License 2.0
106 stars 6 forks source link

AceGPT chat Context window is 1024 tokens? #13

Open yasserkh2 opened 4 months ago

yasserkh2 commented 4 months ago

When using AceGPT-7B-chat and AceGPT-13B-chat models, an error occurred stating that the input must have less than 1024 tokens. The input provided had 1322 tokens. I want to clarify whether this error occurred because it was insufficient to produce just the first response. Additionally, I'm wondering if these models are designed for RAG (Retrieval-Augmented Generation) due to the context window?

AShabana commented 4 months ago

What was the max. size of the QnA you message ? I wonder if the window size of 7B have the same window size of 13B !

hhwer commented 4 months ago

AceGPT support 2048 tokens. And there is no special design for RAG.