why the embedding of '<mask>' is not zeros?

mheinzinger / SeqVec

Modelling the Language of Life - Deep Learning Protein Sequences

MIT License

70 stars 27 forks source link

why the embedding of '<mask>' is not zeros? #11

Closed yy1252450987 closed 4 years ago

yy1252450987 commented 4 years ago

seqvec.embed_sentence(['']) array([[[ 1.4697888e+00, 1.2665360e+00, 1.1649570e+00, ..., -4.7581673e-01, -2.0943403e-01, -5.7467949e-01]],

   [[ 5.6660832e-03,  9.2811551e-04, -3.8819278e-03, ...,
     -3.3947963e-01,  1.0269460e-01,  1.5205227e-01]],

   [[-6.6955321e-02, -1.6270363e-01,  1.9945407e-03, ...,
     -2.4202697e-01,  4.4527851e-02,  1.2317852e-01]]], dtype=float32)