search

microsoft / AI-System

System for AI Education Resource.
https://microsoft.github.io/AI-System/
Creative Commons Attribution 4.0 International
3.64k stars 451 forks source link

New contents 补充in chapter 2 #77

Closed YanjieGao closed 2 years ago

YanjieGao commented 2 years ago

Dear Xiaowu哥，当前transformer, MOE and Pathways系列模型越来越重要，可否帮补一章这类模型结构？与CNN和RNN并列 https://github.com/microsoft/AI-System/tree/main/Textbook/%E7%AC%AC2%E7%AB%A0-%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C%E5%9F%BA%E7%A1%80

YanjieGao commented 2 years ago

Proposal: 2.9 新的模型结构与趋势 2.9.1 基于Transformer的语言模型 2.9.2 更加多样的模型结构-图神经网络 2.9.3 更加稀疏的模型结构-MOE和Pathway