BT-11232 BT-11264 bug bash follow ups - Githubissues

basetenlabs / truss

The simplest way to serve AI/ML models in production

https://truss.baseten.co

MIT License

857 stars 61 forks source link

BT-11232 BT-11264 bug bash follow ups #1001

Closed bdubayah closed 3 weeks ago

bdubayah commented 3 weeks ago

:rocket: What

automatically bump up cpu memory to when using engine builder flow
detect missing hf token if model isn't public

:computer: How

:microscope: Testing

linear[bot] commented 3 weeks ago

BT-11232 Pick correct gpu instance for engine builder flow

BT-11264 Detect misconfiguration sooner in Truss. For example, detect missing hf_access_token when the model needs it