-
### 🐛 Describe the bug
When running Roberta Question Answering (and also other Huggingface models) in CPU inference mode, I get an extra output returned by dynamo, that did not happen in a previous…
-
### The model to consider.
Is vllm currently supports FacebookAI/roberta-large for inference?
if yes please share the example notebooks as the reference
if no please consider FacebookAI/roberta-lar…
-
### Feature request
When attempting to use this reranker model [mxbai-rerank-large-v1](https://huggingface.co/mixedbread-ai/mxbai-rerank-large-v1) from huggingface with TEI, I got the following error…
-
### Describe the issue
I use the following configuration, why is it throwing an error? I see a lot of 512 configurations in the llmlingua installation path. Do I need to retrain the model, or is it a…
-
What should I specify as the `model_type` in the JSON file?
from transformers import AutoModel
model = AutoModel.from_pretrained("zxhezexin/openlrm-obj-base-1.1")
ValueError: Unrecogniz…
-
### Feature request
It would be amazing if 0-shot text classifiers that are designed to work with the [HF zeroshot pipeline](https://huggingface.co/docs/transformers/en/main_classes/pipelines#transfo…
-
The reproduction of the results on Overall is not very good. I ran it on V100, and here are my parameter settings and experimental results. May I ask what the reason is, or how should I reproduce it c…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Hello I have a problem with index.
This is how I generate index:
```
embed_mo…
-
### Describe the issue
Following the [issue 155](https://github.com/microsoft/LLMLingua/issues/155), I'm trying to reproduce the results of the official [llmlingua-2-xlm-roberta-large-meetingbank](…
-