search

triton-inference-server / pytriton

PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
https://triton-inference-server.github.io/pytriton/
Apache License 2.0
687 stars 45 forks source link

[Question] What is the relationship between "model_repository" and "infer_func"? #70

Closed leafjungle closed 2 months ago

leafjungle commented 2 months ago

If I copy "https://github.com/triton-inference-server/server/tree/main/docs/examples/model_repository" into pytriton, and for the standard TensorFlow/Onnx models, do we still need to write the "infer_func"?

Example: config = TritonConfig(model_repository=xxx) triton = Triton(config=triton_config) triton.bind(infer_func=xxx)