search

maxwelljoslyn / gm-trainer

Provide a training ground for RPG Game Masters by using LLMs as pseudo-players.
0 stars 0 forks source link

Input size in tokens might be climbing steadily even if I write relatively small GM responses #7

Open maxwelljoslyn opened 7 months ago

maxwelljoslyn commented 7 months ago

Looking at my Anthropic logs:

Screen Shot 2024-04-16 at 22 17 13 PDT
maxwelljoslyn commented 7 months ago

I can't tell if this is because the input actually means the entire conversation so far and that's obviously going to just increase in size over time, or if I'm somehow accidentally sending too much stuff from each GM response, i.e. perhaps I'm accidentally appending too many pieces of information to what gets sent to each LLM.

Should be easy to determine which of those cases it is. And if the former, nothing I can do.