Tracking instruction-tuned LLM openness. Paper: Liesenfeld, Andreas, Alianda Lopez, and Mark Dingemanse. 2023. “Opening up ChatGPT: Tracking Openness, Transparency, and Accountability in Instruction-Tuned Text Generators.” In Proceedings of the 5th International Conference on Conversational User Interfaces. doi:10.1145/3571884.3604316.
This is one of the first and most widely used instruction-tuned architectures based on RedPajamas data
https://huggingface.co/togethercomputer/RedPajama-INCITE-Instruct-3B-v1