Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
GNU Affero General Public License v3.0
415
stars
23
forks
source link
Gemma2 inference issues on fastchat and mlx server #144
Open
dadmobile opened 3 months ago
Using Gemma 2 9B IT: