search

smallcloudai / refact

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
https://refact.ai
BSD 3-Clause "New" or "Revised" License
1.56k stars 105 forks source link

Llama3 #428

Closed mitya52 closed 4 months ago

mitya52 commented 4 months ago

Llama3 models are gated, so we need to add some tricks to run it on this server:

  1. HF Token in UI and backend: #427
  2. refact-lsp support