Interesting LLM Papers or Projects

[connglli]

This post records some papers or projects that are orthogonal to my research but I'm super interested in or I love very much. Just a reminder for me and perhaps for you.

Remake GPT

• Technical report of GPT-{2,3,4}, O1, LLaMA3, MoE, QWen2, and StarCoder v2.
• nanoGPT ... and many projects from @karpathy

Create Agents

• BabyAGI
• AutoGPT
• AutoGen
• Voyager
• SWE-agent
• Aider
• Agentless

Enable Multi-Modal

• miniGPT4
• AnyMAL

Resolve Contexts

• Streaming-LLM
• MemGPT
• LLMLingua

Fast Inference

• llama.c
• llama.cpp
• gpt-fast
• HF TGI
• FlashAttention
• vLLM & PagedAttention
• TRT (TensorRT)
• SRT (SGLang Runtime) & RadixAttention
• vAttention
• PT FlexAttention
• Efficient Large Language Models: A Survey
• Keep the Cost Down: A Review on Methods to Optimize LLM's KV Cache Consumption

Jailbreak LLMs

• GPTFuzz
• When LLMs Meet Cybersecurity: A Systematic Literature Review

Engineer Prompt

• Prompt Engineering Guide