-
- [ ] [RichardAragon/MultiAgentLLM](https://github.com/richardaragon/multiagentllm)
# RichardAragon/MultiAgentLLM
**DESCRIPTION:** "Multi Agent Language Learning Machine (Multi Agent LLM)
(Update)…
-
A recent [paper](https://arxiv.org/pdf/2309.17453.pdf) by Meta/MIT/CMU proposed [StreamingLLM](https://github.com/mit-han-lab/streaming-llm/), a simple yet efficient solution to enable "infinite" cont…
-
Hi all, this issue will track the feature requests you've made to TensorRT-LLM & provide a place to see what TRT-LLM is currently working on.
Last update: `Jan 14th, 2024`
🚀 = in development
#…
-
- [ ] [Best way to add knowledge to a llm : r/LocalLLaMA](https://www.reddit.com/r/LocalLLaMA/comments/1ao2bzu/best_way_to_add_knowledge_to_a_llm/)
# Best way to add knowledge to a LLM: r/LocalLLaMA…
-
- [ ] [At the Intersection of LLMs and Kernels - Research Roundup](https://charlesfrye.github.io/programming/2023/11/10/llms-systems.html)
# At the Intersection of LLMs and Kernels - Research Roundup…
-
### 🚀 The feature, motivation and pitch
This paper might be of interest: https://arxiv.org/pdf/2306.14048.pdf
This paper mentions removing a small portion of the KV cache does not affect the resul…
-
Have everything running on python3.10 under ubuntu 22.04 with 2x 24 gig gpus.
Tested original and revised versions of 'mt_bench.jsonl' and output is good with a 70b 4bit gptq model.
Trying to incr…
-
- [ ] [Finetuning LLMs for ReAct. Unleashing the power of finetuning to… | by Pranav Jadhav | Feb, 2024 | Towards AI](https://pub.towardsai.net/finetuning-llms-for-react-9ab291d84ddc)
# Finetuning L…
-
### System Info
started receiving this error after rebuilding image today - that I believe picked up #1274 . (using `pip3 install tensorrt_llm -U --pre --extra-index-url https://pypi.nvidia.com`).
…
-
I read the following llama.cpp Issue, I want use this feature. How can I do?
https://github.com/ggerganov/llama.cpp/issues/3440