Closed mkemka closed 1 year ago
Hi Martin, please have a look at the Galactica paper, especially appendix sections A.1 and A.6. Model outputs can combine multiple data sources in a non-trivial way so it's not always possible to track them back. The NatureBook corpus includes English wikipedia, which contains lots of movie plots and biographies of actors, which might partially explain the above non-scientific generation.
First of all thank you so much for making this available. I don't want to take anything away from this extraordinary technical work but I am curious about the source data. Is there any way I can easily track exactly where in the model this type of answer is getting generated from and ideally - which scientific paper(s) have these references?
edit: added new line characters to split the response