I've rewritten the original section that I wrote on the code walkthrough. This should be a lot more high-level with inspiration taken from this article ( https://modal.com/docs/examples/tgi_mixtral ) that they recently published.
I wasn't able to refactor the custom image to use a volume so I've kept the run_function instead since it seems to be a much simpler implementation
I've rewritten the original section that I wrote on the code walkthrough. This should be a lot more high-level with inspiration taken from this article ( https://modal.com/docs/examples/tgi_mixtral ) that they recently published.
I wasn't able to refactor the custom image to use a volume so I've kept the
run_functioninstead since it seems to be a much simpler implementation