issues
search
openvinotoolkit
/
model_server
A scalable inference server for models optimized with OpenVINO™
https://docs.openvino.ai/2024/ovms_what_is_openvino_model_server.html
Apache License 2.0
658
stars
208
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[WIP] Ovms windows
#2720
rasapala
opened
3 days ago
0
OpenAI API completions endpoint - Not working as expected
#2719
anandnandagiri
opened
3 days ago
4
Add scripts to run gpu unit tests
#2718
dkalinowski
opened
4 days ago
2
Introduce echo parameter for text generation
#2717
mzegla
opened
1 week ago
0
Update UBI version
#2716
vaibhavjainwiz
opened
1 week ago
0
Removed tokenizer param
#2715
bstrzele
opened
1 week ago
1
C-API string support
#2714
atobiszei
closed
4 days ago
0
Atobisze capi string
#2713
atobiszei
opened
1 week ago
0
Fixed style check in ci
#2712
bstrzele
closed
1 week ago
0
Fix single chunk response for CB calculator
#2711
mzegla
closed
1 week ago
0
Callback with reload2
#2710
rasapala
closed
1 week ago
0
Change python deps installation in continuous batching demo
#2709
mzegla
closed
1 week ago
0
fixing logprobs in greedy search
#2708
dtrawins
closed
1 week ago
0
Cannot install OpenVINO tokenizer 2024.4 with optimum-intel as given in readme
#2707
dhandhalyabhavik
opened
1 week ago
1
Remove old TODOs in LLM tests
#2706
mzegla
closed
1 week ago
0
Use dnf in dockerfile.redhat
#2705
dtrawins
closed
1 week ago
0
Demo: LLM models with Continuous Batching via OpenAI API not working
#2704
paguilomanas
closed
1 week ago
1
C-API demo package update [release branch]
#2703
dkalinowski
closed
1 week ago
0
C-API demo package update [main]
#2702
dkalinowski
closed
1 week ago
0
update stable diffusion model in python demo
#2701
dtrawins
closed
1 week ago
0
update stable diffusion model in python demo
#2700
dtrawins
closed
1 week ago
0
use public pip packages in text generation demo
#2699
dtrawins
closed
2 weeks ago
0
Update to public ov 2024.4
#2698
rasapala
closed
2 weeks ago
0
Mitigate sporadic in unit test
#2697
dkalinowski
closed
1 week ago
0
Update links
#2696
dkalinowski
closed
2 weeks ago
0
Remove outdated TODOs and TODOs that are already in jira
#2695
dkalinowski
closed
1 week ago
0
drop not needed python file
#2694
dtrawins
closed
1 week ago
0
Switch Dockerfile.redhat over to use dnf
#2693
stevegrubb
closed
1 week ago
1
LLM calculator documentation updates
#2692
dtrawins
closed
2 weeks ago
0
MediaPipe generic metrics documentation
#2691
dkalinowski
closed
2 weeks ago
0
CVS-151872_update_sdl_lists
#2690
ngrozae
closed
2 weeks ago
0
Update genAI dependency
#2689
dtrawins
closed
2 weeks ago
0
update continuos batching demo with new features
#2688
dtrawins
closed
2 weeks ago
0
update tokenizer and genai
#2687
dtrawins
closed
3 weeks ago
0
Update python-opencv
#2686
rasapala
closed
1 week ago
0
Warn about unsupported NPU on ubuntu20 during build
#2685
dtrawins
closed
2 weeks ago
0
Fix Mediapipe API docs
#2684
atobiszei
closed
2 weeks ago
0
C-API output tensors reset
#2683
atobiszei
opened
3 weeks ago
0
warn about python version require to prepare test models
#2682
dtrawins
closed
2 weeks ago
0
[DOCS] Directing references to OMZ repository
#2681
sgolebiewski-intel
closed
2 weeks ago
0
drop text generation demo in python which have replacement with conti…
#2680
dtrawins
closed
2 weeks ago
0
initial implementation for logprobs
#2679
dtrawins
closed
3 weeks ago
0
Update coverity
#2678
atobiszei
closed
2 weeks ago
1
Minor coverity fixes
#2677
atobiszei
opened
3 weeks ago
0
Review
#2676
atobiszei
opened
3 weeks ago
0
Cherry-pick from TFS: Upgraded libevent to 2.1.12. Fixed minor bug in EvHTTPServer.
#2675
dkalinowski
closed
3 weeks ago
0
Mkulakow/support enable prefix caching
#2674
michalkulakowski
closed
3 weeks ago
0
update ov runtime to rc2
#2673
dtrawins
closed
4 weeks ago
0
cvs-151579 update benchmark_serving.py output: Total Token throughput
#2672
porlows1
closed
3 weeks ago
0
Fix resource cleaner unit test sporadic failure
#2671
dkalinowski
closed
3 weeks ago
0
Next