search

clay-lab / transductions

A PyTorch framework for creating, running, and reproducing experiments on seq2seq models.
6 stars 3 forks source link

Nondeterminism #46

Open jopetty opened 3 years ago

jopetty commented 3 years ago

Just found a weird example of model non-determinism. On the REPL, a transformer model gave the following output:

> sem himself
[2021-01-07 14:10:34,147][core.trainer][INFO] - himself → fly ( )
> sem himself
[2021-01-07 14:10:39,461][core.trainer][INFO] - himself → fly ( bob )
> sem himself
[2021-01-07 14:10:42,081][core.trainer][INFO] - himself → fly ( bob )
> sem himself
[2021-01-07 14:10:46,542][core.trainer][INFO] - himself → fly ( )

I suspect this is because we don't save the Fields anymore....