find the Human Normalised Score metric in the log

eureka-research / Eureka

Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models" (ICLR 2024)

https://eureka-research.github.io/

MIT License

2.84k stars 258 forks source link

find the Human Normalised Score metric in the log #22

Open HuiHuiSun opened 1 year ago

HuiHuiSun commented 1 year ago

I like your work very much. I am reproducing your results in this paper. I have successfully run the eureka.py code and got many log files. I can only find the Success Rate metric but can not in these log files. Can you tell me where this metric is stored or how to calculate it? Here are some logs. env_iter4_response2.txt eureka.log reward_code_eval4.txt

claraadam commented 11 months ago

Same issue here, did you solve it ?

sihany077 commented 10 months ago

Evaluation metrics for different tasks can be found in the environment code, along with their calculation methods.