search

basetenlabs / truss-examples

Examples of models deployable with Truss
https://trussml.com
MIT License
130 stars 37 forks source link

reproduce oom #339

Open tianshuc0731 opened 1 month ago

tianshuc0731 commented 1 month ago

Simply throwing runtime exception at the end of load() function will trigger load() restart and GPU oom. deployment logs: https://app.baseten.co/models/7qk7k59w/logs/32lxl2w