sotopia-lab / sotopia

Sotopia: an Open-ended Social Learning Environment (ICLR 2024 spotlight)
https://docs.sotopia.world
MIT License
168 stars 21 forks source link

feat(exp_eval): support tag for combo iteration #245

Closed lwaekfjlk closed 2 weeks ago

lwaekfjlk commented 2 weeks ago

Closes #

📑 Description

✅ Checks

ℹ Additional Information

lwaekfjlk commented 2 weeks ago

I sort based on pk once retrieve all the data to make sure partial running can be achieved in a fixed order. Additionally, I pass the tag into the iterat_combo function.

codecov[bot] commented 2 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 72.88%. Comparing base (71d6199) to head (fbcae07). Report is 14 commits behind head on main.

@@            Coverage Diff             @@
##             main     #245      +/-   ##
==========================================
+ Coverage   71.40%   72.88%   +1.47%     
==========================================
  Files          55       58       +3     
  Lines        2868     2972     +104     
==========================================
+ Hits         2048     2166     +118     
+ Misses        820      806      -14     

see 18 files with indirect coverage changes