-
### Context
We see that basic chatglm output generated words are repetitive.
![image](https://github.com/openvinotoolkit/openvino.genai/assets/98947310/f237a08b-a4db-4c6d-80f8-83abb762ad89)
###…
-
### Feature Description
Basically a SimpleChatEngine equivalent for Multimodal models so they can also take in memory and chat_history parameters.
### Reason
Don't know if there is already an abst…
-
Focus on evaluating the effectiveness of the whole framework against prompt injection attacks
in terms of ai agent:
we have user, cam, lidar, pos as perception, pretrained LLM as brain, command signa…
-
**Is your feature request related to a problem? Please describe.**
When generating a complex schema, sometimes I want to interleave generation, templating, and tool use. One way to support this would…
-
### Ticket Contents
iGOT Karmayogi has a course or a micro-learning content which beautifully explains the concept. However, user is unaware of the course content or how to search for a course or a c…
-
Firstly thanks for the awesome work in putting this all together in record time ! One burning question for me is how the current structure of the agents which look to be stateless stacks up against a …
-
### Proposal to improve performance
currently, `LLMEngine` (driver) lives in the same process as tensor parallel rank 0 process, which caused a lot trouble for us, e.g. we cannot easily create two in…
-
### Describe the bug
Crashes when using -m ollama/LLaVA -lsv, works fine without -lsv parameter
### Reproduce
Run interpreter -m ollama/llava -lsv
Ask for a visual description
### Expected beha…
-
[High-Level Architecture Overview](https://docs.google.com/drawings/d/1TxRxJ7Amy449dvnFgOrnqofX3SfkLD3qqqKXEAfRHsE/edit?usp=sharing)
![LLM-VM Architecture](https://github.com/anarchy-ai/LLM-VM/asse…
-
### Motivation.
Currently, guided decoding & logit processor API is incomplete has has several issues. The RFC is intended to bring up problems and solutions. Some of issues may have been already a…