Closed BiEchi closed 1 year ago
Some newer models like OPT treat embedding layers as a separate layer 'Embedding' instead of pure tensor.
Some newer models like OPT treat embedding layers as a separate layer 'Embedding' instead of pure tensor.