search

dair-ai / nlp_paper_summaries

✍️ A carefully curated list of NLP paper summaries
MIT License
1.47k stars 245 forks source link

Recipe for Transformers #19

Closed omarsar closed 2 years ago

omarsar commented 4 years ago

A great summary of improvements in Transformers. It could be used to extract a great recipe around this topic.

https://lilianweng.github.io/lil-log/2020/04/07/the-transformer-family.html

vrdn-23 commented 4 years ago

Aah yes. This is really neat! I'll (hopefully) have a recipe that we can build up on by the end of this week hopefully.

vrdn-23 commented 4 years ago

Aah yes. This is really neat! I'll (hopefully) have a recipe that we can build up on by the end of this week hopefully.

So this unfortunately did not pan out. I would still need some time to compile the resources together. Would anyone want to give it a go in the meantime or is it fine if I stick with it? I think I can get something concrete by the end of this month.

omarsar commented 4 years ago

@JavaiMaster sounds good to me. No rush! I think the more time you take to prepare it the better I am sure it will come out. :)

vrdn-23 commented 4 years ago

https://github.com/graykode/nlp-roadmap Leaving this here as a reference. @omarsar do you think this is something we can build upon as a recipe template? Probably encourage users to add their own tidbits ?

omarsar commented 4 years ago

@vrdn-23 This will be great to build upon. I agree!