-
Is it possible to open source the weights and config before the conversion to Huggingface, similar to [santacoder-megatron](https://huggingface.co/bigcode/santacoder-megatron)? Thanks!
-
![image](https://github.com/smallcloudai/refact-self-hosting/assets/92613744/8a804894-42c2-480f-99d9-4c6c3e52ce71)
![image](https://github.com/smallcloudai/refact-self-hosting/assets/92613744/a8c818b…
-
llm_load_print_meta: n_embd_head_k = 128
llm_load_print_meta: n_embd_head_v = 128
llm_load_print_meta: n_gqa = 7
llm_load_print_meta: n_embd_k_gqa = 1024
llm_load_print_meta: …
-
Hi,
I've been checking the example that used `OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5` model. This model uses the following tokens to specify the beginning of the user and assistant:
```
…
-
Enabling either Admins or users to set their own/assign a API key, instead of the whole organization. This could be helpful to create usage reports by user, by assigning each a different API key. …
-
**Describe the bug**
Unable to see output text after request. The output can be copied, but the text itself is invisible in the window. The problem occurs regardless of the providers
**To Reproduce*…
-
-
I imagine you want to add support for [Google's Bard](https://bard.google.com/) and [Stanford's Alpaca](https://crfm.stanford.edu/2023/03/13/alpaca.html), any other LLMs that you had in mind?
-
Wow just found this incredible project. This looks super cool!
The only thing I am missing currently is the possibility of using local Huggingface models. Currently it looks to me, that the you can…
-
Is it possible to add an option to merge Lora with the base model? **From local directories.** Because sometimes it's convenient. Since the existing scripts for merging Lora and the model do not work …