Closed DaveDeCaprio closed 3 months ago
sanitize_prompt has a "history" argument, but was ignoring it. Here, I convert it to a string and include it in the token count. That's not perfect, but provides a better estimate than ignoring it.
sanitize_prompt has a "history" argument, but was ignoring it. Here, I convert it to a string and include it in the token count. That's not perfect, but provides a better estimate than ignoring it.