Closed mustafa-tariqk closed 4 months ago
Is your feature request related to a problem? Please describe. Server on prod is down, likely due to the system spazzing bc of token limits.
Describe the solution you'd like Precompute values, have server just do inference
Describe alternatives you've considered Dumping more credits at it
Additional context Add any other context or screenshots about the feature request here.
Is your feature request related to a problem? Please describe. Server on prod is down, likely due to the system spazzing bc of token limits.
Describe the solution you'd like Precompute values, have server just do inference
Describe alternatives you've considered Dumping more credits at it
Additional context Add any other context or screenshots about the feature request here.