notebook: Plots for go-defense paper

tomtseng commented 7 months ago

Add notebook for counting total number of inferences in a training run (used for adjusting compute estimates of inefficient training runs — r1 using too few threads, ViT used FP32)
Add notebooks for generating plots for defense paper
- I made new notebooks defense-* despite some similar code to our previous notebooks — I didn't want to have to scroll through cells of old go-attack paper plots, plus I'm running the notebooks on Flamingo now instead of CHAI so a bunch of the paths are broken
- Cyclic heatmap notebook copied from https://github.com/AlignmentResearch/go_attack/pull/135 which Tony already approved

Code quality isn't great, there's a lot of copy-and-pasting and not much thought to refactoring. Should just skim and aggressively leave questions as comments here rather than trying to decipher low-quality code

review-notebook-app[bot] commented 7 months ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

netlify[bot] commented 7 months ago

Deploy Preview for goattack canceled.

Name	Link
Latest commit	1625eedab1e6f40c60dd15e2b5ec5fb077286f65
Latest deploy log	https://app.netlify.com/sites/goattack/deploys/6657f24f68cf450008b424cd

tomtseng commented 3 weeks ago

merged without review as discussed in last week's meeting

AlignmentResearch / KataGoVisualizer