On index bug-fix of AR experiments script and corresponding paper results

HazyResearch / zoology

Understand and test language model architectures on synthetic tasks.

Apache License 2.0

164 stars 28 forks source link

Closed atsushi3110 closed 9 months ago

atsushi3110 commented 9 months ago

Hi, thanks for your sharing great code base.

In the latest version of paper in arxiv, did all experiments run after the following bug-fix ?

simran-arora commented 9 months ago

Hi we actually used the multi-query associative recall data in all the paper experiments (not the _ar). If you checkout the same file you should see that data constructor: https://github.com/HazyResearch/zoology/blob/967684304b9fb0d977289bacadedb3ab407214cd/zoology/data/associative_recall.py#L166 Let us know if you have any more questions