search

ChrisFuscoMasters / TransformerLib

Facilitates my research
0 stars 0 forks source link

Sequence Prediction #2

Open CJcool06 opened 1 year ago

CJcool06 commented 1 year ago

The output of the Transformer should be the entire predicted sequence. This is accomplished by:

  1. Decoder is given token
  2. Decoder predicts the next token
  3. Predicted token is added to decoder input (now and
  4. Decoder predicts next token
  5. Repeat until the decoder predicts the token, then output the entire predicted sequence

Once finished, #1 will needed to be implemented to have the transformer working correctly.