Open SinanAkkoyun opened 5 months ago
Hi! I'd love vLLM and exllamav2 support and wanted to help with that. Is the LLM side of the model pure llama2 architecture (not counting the lin. proj. layers)?
Thank you in advance
Hi! I'd love vLLM and exllamav2 support and wanted to help with that. Is the LLM side of the model pure llama2 architecture (not counting the lin. proj. layers)?
Thank you in advance