search

LavLabInfrastructure / lavlab-olympus-ansible

0 stars 0 forks source link

add triton inference server #3

Open barrettMCW opened 7 months ago

barrettMCW commented 7 months ago

allows ai as a service. required for xnat aiaa, and tpm ui.

barrettMCW commented 6 months ago

nvidia's helm chart is pretty shotty and won't do the job in our case. need to fork it, add proper volume/environement configurations, and add runtimeclass configuration.

barrettMCW commented 6 months ago

installed, but need to whip up the model repository

barrettMCW commented 4 months ago

reevaluate use of triton