-
I've been reading up on Text-to-SQL problems (given natural language question & DB schema, generate a legal SQL query) and they seem to be an interesting subfield of Dialogue Answering Systems.
Th…
-
I'm getting this error when running MIPRO:
```
AttributeError: 'Predict' object has no attribute 'new_signature'. Did you mean: 'signature'?
```
This is how I run MIPRO:
```
teleprom…
-
I have tried your llama example and the output is **random** and took 770 second to finish:
**commmand :**
```
python src/run_generation.py --model_type llama --model_name_or_path meta-llama/Ll…
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
There's a bug in attack_manager.py:
```
if self.conv_template.name == 'llama-2':
self.conv_template.messages = []
self.conv_template.append_message(self.conv_template.roles…
-
Support for RAG with Q&A Model via Connector. Currently we can do RAG only with text generation models
I am using Q&A model for RAG
The Q&A Model takes two inputs as `question` and `context`
```
…
-
This assessment data also appears to be in the form of multiple choice tasks similar to MMLU, but there are many detailed differences in the practice of MMLU, and these detailed differences have a sig…
-
Thanks for your awesome work! Section 4.2 states that you present a long video understanding benchmark, would you please release the prompt the generate questions and answers for this benchmark? Thank…
-
Hi, I've been ingesting pdf files of 400+ pages, but it takes very long or sometimes it just gets stuck (I have increased combined chunk-size to 20) but is still not enough.
Is there a way to make…
-
Faithfulness is not callable