google-deepmind / emergent_communication_at_scale

Apache License 2.0
33 stars 6 forks source link

Provided values do not match plot #3

Open leonl42 opened 1 year ago

leonl42 commented 1 year ago

Hey,

In your paper you report that "agents achieve an accuracy of 87.36%, 93.25%, 96.09% when trained on 64, 256, and 1024 candidates respectively". However, if I analyzed figure 2 b) correctly, 87.36% should be the value of the line with |C| = 16 and |C| = 64 should be at ~90 % accuracy. Is this just a typo or did I miss something?

Best regards