search

OpenMOSS / MOSS

An open-source tool-augmented conversational language model from Fudan University
https://txsun1997.github.io/blogs/moss.html
Apache License 2.0
11.9k stars 1.14k forks source link

Model Architecture #308

Open Hegelim opened 1 year ago

Hegelim commented 1 year ago

What is the architecture of the model? Is it decoder-only or encoder-decoder or something else? Is there a technical report or paper?

moseshu commented 1 year ago

https://github.com/OpenLMLab/MOSS/blob/main/models/modeling_moss.py. I think it's only decoder.very common architecture