microsoft / UniVL

An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
https://arxiv.org/abs/2002.06353
MIT License
339 stars 54 forks source link

The bert univl using is very different from Huggingfaces' (or pytorch's) bert #15

Closed butterluo closed 3 years ago

butterluo commented 3 years ago

Wihich version of implementation of bert are u using? I found the bert univl using is very different from Huggingfaces' (or pytorch's) bert, cause the output of them are very different even with the same input.