timaeus-research / icl

Understand the development of in-context learning in transformers with linear regression data
1 stars 0 forks source link

Extract 'Evaluator' class and a few other changes more #2

Closed matomatical closed 1 year ago

matomatical commented 1 year ago

As part of understanding the script enough to get a sweep running from my machine I was struggling because of how much code there was in the train function, and how model configuration was split between ICLCOnfig defaults and explicit values in get_config function.

A small number of other miscellaneous local changes were made (see diff and comments on GitHub PR).

jqhoogland commented 1 year ago

Great I'd had the same idea and am glad you went ahead and dit it