Closed anton-bushuiev closed 1 year ago
Currently, setting input_degrees > 1 and passing a fiber dict to forward leads to a bug because forward tries to apply token embedding and positional embedding to a dict rather than a tensor with type-0 features. This PR fixes this minor issue.
input_degrees > 1
forward
@anton-bushuiev thank you for this!
Currently, setting
input_degrees > 1
and passing a fiber dict toforward
leads to a bug becauseforward
tries to apply token embedding and positional embedding to a dict rather than a tensor with type-0 features. This PR fixes this minor issue.