search

ZhuiyiTechnology / GAU-alpha

基于Gated Attention Unit的Transformer模型（尝鲜版）
94 stars 9 forks source link

tensorflow 1.14 训练过程发生报错。 #1

Open natureLanguageQing opened 2 years ago

natureLanguageQing commented 2 years ago

TypeError: list indices must be integers or slices, not tuple

baudzhou commented 2 years ago

This error raise at \site-packages\bert4keras\layers.py line 646. qk = apply_rotary_position_embeddings(inputs[n], qk) This function returns a list, but next line q, k = qk[:, :, 0], qk[:, :, 1] requests a tensor. Changing to qk = apply_rotary_position_embeddings(inputs[n], qk)[0] solved this issue. Wish @bojone could fix bert4keras.

ZhuiyiTechnology commented 2 years ago

sorry for my mistake and updating bert4keras to 0.11.3 will fix it.