search

replicate / cog-triton

A cog implementation of Nvidia's Triton server
Apache License 2.0
11 stars 0 forks source link

Refactor predict method to include additional arguments. Add health c… #4

Closed joehoover closed 6 months ago

linear[bot] commented 6 months ago
LANG-184 add standard sampling parameters to cog-triton

cog-triton's input params are very limited right now. We need to update these to at least match our current official models.