shylee2021
commented
4 months ago RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs https://arxiv.org/abs/2407.02552
Instruction Pre-Training: Language Models are Supervised Multitask Learners https://arxiv.org/abs/2406.14491 https://huggingface.co/instruction-pretrain/instruction-synthesizer
Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793
MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases (ICML 2024) https://arxiv.org/abs/2402.14905
BERGEN: A Benchmarking Library for Retrieval-Augmented Generation https://arxiv.org/pdf/2407.01102
seyong92
https://www.microsoft.com/en-us/research/blog/graphrag-new-tool-for-complex-data-discovery-now-on-github/
Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems https://arxiv.org/abs/2407.01370