issues
search
triton-inference-server
/
openvino_backend
OpenVINO backend for Triton.
BSD 3-Clause "New" or "Revised" License
29
stars
16
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Responder should explicitly use 'first dimension batching'
#33
deadeyegoodwin
closed
2 years ago
0
Add support for building OV 2021.4
#32
tanmayv25
closed
2 years ago
0
Askhade/windows cuda arch fix
#31
deadeyegoodwin
closed
3 years ago
0
Fix comment that prevents loading of FP16 models
#30
CoderHam
closed
3 years ago
2
Add dynamic shape limitations for openvino in known issues
#29
CoderHam
closed
3 years ago
0
Add more dependencies to enable CPU only build
#28
jbkyang-nvi
closed
3 years ago
0
fix bug
#27
zhaohb
closed
3 years ago
4
Add support for building OV 2021.04
#26
tanmayv25
closed
3 years ago
1
Support for OV 2021.4 library
#25
tanmayv25
closed
2 years ago
3
Modify backend to be host policy aware
#24
GuanLuo
closed
3 years ago
0
Add windows build support
#23
deadeyegoodwin
closed
3 years ago
0
Document supported devices for backend
#22
tanmayv25
closed
3 years ago
0
Build OV library with OMP support on linux
#21
tanmayv25
closed
3 years ago
0
Replace the contiguous check with common utility
#20
GuanLuo
closed
3 years ago
0
Ensure the padding uses separate buffer with zeroed out values
#19
tanmayv25
closed
3 years ago
0
Allow model_config dims to reshape the OV model
#18
tanmayv25
closed
3 years ago
3
Add TRITON_BUILD_CONTAINER arg for cmake
#17
deadeyegoodwin
closed
3 years ago
0
Document beta quality of backend
#16
deadeyegoodwin
closed
3 years ago
0
Fix memory leak and prevent an extra data copy
#15
tanmayv25
closed
3 years ago
0
Provide buffer size while wrapping the blob
#14
tanmayv25
closed
3 years ago
0
Pad input tensor data to handle requests with bs != max_batch_size
#13
tanmayv25
closed
3 years ago
0
Print model config used to initialize the model in the logs
#12
tanmayv25
closed
3 years ago
0
Adding some checks and minor fixes
#11
tanmayv25
closed
3 years ago
0
Fixing documentation
#10
tanmayv25
closed
3 years ago
0
Handle OV exception when getting input info
#9
tanmayv25
closed
3 years ago
0
Add an option to skip dynamic batch sizes
#8
tanmayv25
closed
3 years ago
0
Add documentation for the build and config parameters for OV backend
#7
tanmayv25
closed
3 years ago
0
Exposing plugin configuration through model_config parameters
#6
tanmayv25
closed
3 years ago
0
Allow multiple instances to share the weights
#5
tanmayv25
closed
3 years ago
0
Add inference support to the backend
#4
tanmayv25
closed
3 years ago
0
Load openVINO model instances in the backend
#3
tanmayv25
closed
3 years ago
2
Fix the build to include necessary includes and library files
#2
tanmayv25
closed
3 years ago
0
Remove hardcoded openVINO build number from openvino dockerfile gener…
#1
tanmayv25
closed
3 years ago
0
Previous