OpenBMB / BMTrain

Efficient Training (including pre-training and fine-tuning) for Big Models
Apache License 2.0
548 stars 74 forks source link

test_synchronize.py #161

Closed JerryYin777 closed 1 year ago

JerryYin777 commented 1 year ago

构建了完整的测试文件 在修改之前,如果传入的tensor是其他大tensor的切片,gather时会报错:"Buffer size not aligned" 构造一个大的tensor A 构造一个小tensor B指向A的一个区间 gather_result(B) 会出现“Buffer size not aligned"