Configs for 85% and 90% sparse models

numenta / nupic.research

Experimental algorithms. Unsupported.

https://nupicresearch.readthedocs.io

GNU Affero General Public License v3.0

104 stars 60 forks source link

Configs for 85% and 90% sparse models #528

Closed mvacaporale closed 3 years ago

mvacaporale commented 3 years ago

@benja-matic Here are the configs for the 85% and 90% sparse BERT-Base models. I did fine-tune these, but I think it'd be better if you adjusted the configs and reran given your recent enhancements to fine-tuning. Particularly, please feel free to edit finetuning_bert_sparse_85_trifecta_100k_glue and finetuning_bert_sparse_90_trifecta_100k_glue.

lucasosouza commented 3 years ago

@mvacaporale This PR has been pending for 11 days, but it looks like it is a simple adjustment to experiments file. Should we go ahead and merge this, or is it missing something still?

lucasosouza commented 3 years ago

Closed as commits were part of another PR, just merged: https://github.com/numenta/nupic.research/pull/537