The prompt length is too long after like 10 posts - need to only pass the first section of prompt.txt (everything before the first post). Otherwise, the bot fails after ~10 posts due to token length exceeding ~4k. Also, the posts get increasingly more expensive on each post until it fails.
The prompt length is too long after like 10 posts - need to only pass the first section of prompt.txt (everything before the first post). Otherwise, the bot fails after ~10 posts due to token length exceeding ~4k. Also, the posts get increasingly more expensive on each post until it fails.