PR #150 introduces some untidy code in an effort to quickly get evaluation of activation normalisation working. This code should be tidied up, most likely by moving activation normalisation calculations into either the SAE or fully back into the activation store.
Context
I (@tomMcGrath) intend to do this on the week beginning 20th May. If this issue still exists by the 24th, please bug me about it.
Checklist
[x] I have checked that there is no similar issue in the repo (required)
Proposal
PR #150 introduces some untidy code in an effort to quickly get evaluation of activation normalisation working. This code should be tidied up, most likely by moving activation normalisation calculations into either the SAE or fully back into the activation store.
Context
I (@tomMcGrath) intend to do this on the week beginning 20th May. If this issue still exists by the 24th, please bug me about it.
Checklist