PhilipQuirke / quanta_maths

Tool used to verify accuracy of transformer model
Apache License 2.0
1 stars 1 forks source link

Publish: 3: Verified mixed model #24

Open PhilipQuirke opened 7 months ago

PhilipQuirke commented 7 months ago

To increase visibility of our work, and make it more easily absorbed...

Create a post on LessWrong that describes the algorithm of the perfectly accurate mixed (addition and subtraction) model in https://arxiv.org/abs/2402.02619 . Show the quanta maps and ablation tests used to understand / verify the model. Show the "algorithm description" language.

Prerequisite: The mixed model algorithm must be fully understood before we write this post.
Prerequisite: The "algorithm description" language must have been revamped to make it easier to use / read.