search

triton-inference-server / fastertransformer_backend

BSD 3-Clause "New" or "Revised" License
411 stars 133 forks source link

Is deberta supported in the fastertranformer backend? #148

Open sfc-gh-zhwang opened 1 year ago

sfc-gh-zhwang commented 1 year ago

Looks like the answer is no and it will fail if we put a deberta model: https://github.com/triton-inference-server/fastertransformer_backend/blob/main/src/libfastertransformer.cc#L333.

Is there future plan to support deberta?