-
This is a thread for Carolina to summarize her research on RAG.
The purpose is to share the information among project members.
-
### Feature request
https://arxiv.org/pdf/2401.01325.pdf
Abstract
This work elicits LLMs’ inherent ability to handle
long contexts without fine-tuning. The limited
length of the training sequen…
-
### System Info
- Ubuntu
- GPU A100 / 3090 RTX
- docker nvcr.io/nvidia/tritonserver:24.02-trtllm-python-py3
- Python tensorrt-llm package (version 0.9.0.dev2024030500) installed in the docker im…
-
### Describe the bug
I am trying to run bot but its giving me runtime error for YAML File. I checked YAML FILE for error. ITs not having any Issue
### Steps to reproduce
Its on modified yaml …
-
## Summary
[MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering](https://aclanthology.org/2021.tacl-1.82.pdf)
> _"MKQA contains 10,000 queries sampled from t…
-
### Feature request
We would like to implement fine-tuning.
This task involves considering the tradeoffs between various approaches to improving action completions and outcome evaluation via fin…
-
### Describe the issue
[Usage] When using merge_lora_weights.py, "Supplied state dict for model.layers.0.self_attn.q_proj.weight does not contain `bitsandbytes__*` and possibly other `quantized_stats…
-
Determine the best chunk size for our application.
The application should be able to keep track of individuals, so that RAG can make an appropriate prompt to feed to LLM, and the application can gi…
-
Hello @tomaarsen,
I hope u are doing well. I love the new Sentence Transfomers release!
I am writing to propose a few feature requests that I believe would enhance Sentence Transformers:
- Add …
-
we have a strong community in collecting links, but writing the articles is often done last minute by a few contributors. this is a tedious task. If AI could support in summarizing the links from the …