Closed codemaster-22 closed 3 years ago
Hey why are we not maintaining something like blank token during Inference for each time step , and during training also won't there be some alignment problems ?
Sorry for late response. I handle blank token when converts ids to tokens. like this.
Hey why are we not maintaining something like blank token during Inference for each time step , and during training also won't there be some alignment problems ?