Any plan to update to latest triton version? (23.07)

triton-inference-server / paddlepaddle_backend

BSD 3-Clause "New" or "Revised" License

32 stars 6 forks source link

Any plan to update to latest triton version? (23.07) #21

Open bdeng3 opened 1 year ago

bdeng3 commented 1 year ago

So far the latest publicly available triton inference server with paddle backend is paddlepaddle/triton_paddle:21.10 and there are lots of bug fixes since then. I'm experiencing an increasing amount of bugs that are related older version of triton. Can Paddle Org provides an official update to the triton image?

Or is there any way we could install paddle backend in the latest triton inference server image ourselves?

heliqi commented 1 year ago

For some reason, there is no time to upgrade the triton version. It is expected that the triton version will be updated in September or October.

heliqi commented 1 year ago

One interface needs to be modified to install paddle backend on the latest triton version https://github.com/triton-inference-server/paddlepaddle_backend/blob/6c1c935e9978f5606082cfb372cc74948bcb6e7a/src/paddle.cc#L883