Open gregnr opened 1 month ago
Right now you have to use the rate limiter, even for local development or self hosting. Find a good way to allow developers to disable this (eg. simply omitting KV_REST_API_URL/KV_REST_API_TOKEN env vars) so that the LLM can be used unrestricted.
KV_REST_API_URL
KV_REST_API_TOKEN
Right now you have to use the rate limiter, even for local development or self hosting. Find a good way to allow developers to disable this (eg. simply omitting
KV_REST_API_URL
/KV_REST_API_TOKEN
env vars) so that the LLM can be used unrestricted.