Tracking instruction-tuned LLM openness. Paper: Liesenfeld, Andreas, Alianda Lopez, and Mark Dingemanse. 2023. “Opening up ChatGPT: Tracking Openness, Transparency, and Accountability in Instruction-Tuned Text Generators.” In Proceedings of the 5th International Conference on Conversational User Interfaces. doi:10.1145/3571884.3604316.
As a side note, we released the training code last week. Please reach out with any feedback or other ideas on how LLM360 can meaningfully support open source.
And also
Btw, I notice the leaderboard indicate AmberChat's base to be Llama. AmberChat actually uses our own pretrained base model (https://huggingface.co/LLM360/Amber), though sharing the same architecture as Llama.
See discussion here https://huggingface.co/LLM360/AmberChat/discussions/3
And also