The Triton Inference Server provides an optimized cloud and edge inferencing solution.
BSD 3-Clause "New" or "Revised" License
8.4k
stars
1.49k
forks
source link
refactor: Removing `Server` subclass from `tritonfrontend` #7683
Closed
KrishnanPrash closed 1 month ago
What does the PR do?
Removes the keyword
Server
from thetritonfrontend
package to avoid confusion with multiple definitions ofServer
in the core and frontend bindings.Previously, using
tritonfrontend.KServeHttp
would look like this:New workflow replaces
KServeHttp.Server
with justKServeHttp
: