search

basetenlabs / truss

The simplest way to serve AI/ML models in production
https://truss.baseten.co
MIT License
855 stars 60 forks source link

Can I deploy a Truss app on my own infra? #914

Open Iven2132 opened 2 months ago

Iven2132 commented 2 months ago

Can I deploy a Truss app on my own infra? e.g can i deploy truss app on Modal or Runpod

squidarth commented 2 months ago

Hi @Iven2132 it's not super streamlined, but the way to do this would be to use:

$ truss image build

to build a Docker image from your Truss. You can then run it anywhere that runs docker.

https://truss.baseten.co/reference/cli/image#truss-image-build

Iven2132 commented 2 months ago

Can you give me example of doing that after making a Docker image? What to do after that? To run on my own infra

On Mon, 29 Apr 2024, 21:05 Sidharth Shanker, @.***> wrote:

Hi @Iven2132 https://github.com/Iven2132 it's not super streamlined, but the way to do this would be to use:

$ truss image build

to build a Docker image from your Truss. You can then run it anywhere that runs docker.

https://truss.baseten.co/reference/cli/image#truss-image-build

— Reply to this email directly, view it on GitHub https://github.com/basetenlabs/truss/issues/914#issuecomment-2083056069, or unsubscribe https://github.com/notifications/unsubscribe-auth/A3UMSYTLPBISEEWQYLUV2XTY7ZSFZAVCNFSM6AAAAABG3LKN76VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBTGA2TMMBWHE . You are receiving this because you were mentioned.Message ID: @.***>

Iven2132 commented 2 months ago

Hi @Iven2132 it's not super streamlined, but the way to do this would be to use:

$ truss image build

to build a Docker image from your Truss. You can then run it anywhere that runs docker.

https://truss.baseten.co/reference/cli/image#truss-image-build

@squidarth Any idea about that?