Add flag to specify dtype

AlignmentResearch / tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer

https://tuned-lens.readthedocs.io/en/latest/

MIT License

432 stars 47 forks source link

Add flag to specify dtype #93

Closed levmckinney closed 1 year ago

levmckinney commented 1 year ago

Currently, there is no way to specify the dtype used by the model or the lens during training. We should have a flag for this in the training scripts and the lens from model and pretrained method.