Open Edwardmark opened 1 day ago
Hi, thanks for your great work! What is the number of blocks in v1.3? is it still the same of v1.2? It seems strage not double the block number like stdit.
Yes, since we adopted the 3D attention architecture for 1.2, we don't need to double the number of layers. You can find the number of layers here.
Hi, thanks for your great work! What is the number of blocks in v1.3? is it still the same of v1.2? It seems strage not double the block number like stdit.