PolicyEngine / policyengine-api

PolicyEngine's REST API for computing policy impacts.
GNU Affero General Public License v3.0
7 stars 19 forks source link

Increase `max_tokens` in AI summary #1522

Open MaxGhenis opened 1 month ago

MaxGhenis commented 1 month ago

Currently getting cut off:

image

Output is $75 per million tokens, or 7.5 cents when limiting to 1,000 tokens. Since inequality is one of the last things, I don't think it'd exceed 1,500 uncapped, or 11.25 cents.

https://github.com/PolicyEngine/policyengine-api/blob/8d5ecb7d512e9e7ac12b9fab5154d632bfee95da/policyengine_api/endpoints/analysis.py#L31