search

mrsteele / openai-tokens

A service for calculating, managing, truncating openai tokens
MIT License
18 stars 3 forks source link

Truncate options #3

Closed mrsteele closed 1 year ago

mrsteele commented 1 year ago

Maybe we could pass truncate rules for completions.

truncate: "context"

This could help only truncate context messages (the oldest)