fix max tokens (and optimize imports) - Githubissues

replicate / cog-triton

A cog implementation of Nvidia's Triton server

Apache License 2.0

11 stars 0 forks source link

fix max tokens (and optimize imports) #37

Closed technillogue closed 3 months ago

technillogue commented 3 months ago

accept max_tokens
settle on min/max_tokens to match openai
fix type errors
fix descriptions