find the Human Normalised Score metric in the log

eureka-research / Eureka

Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models" (ICLR 2024)

https://eureka-research.github.io/

MIT License

2.73k stars 244 forks source link

find the Human Normalised Score metric in the log #22

Open HuiHuiSun opened 8 months ago

HuiHuiSun commented 8 months ago

I like your work very much. I am reproducing your results in this paper. I have successfully run the eureka.py code and got many log files. I can only find the Success Rate metric but can not in these log files. Can you tell me where this metric is stored or how to calculate it? Here are some logs. env_iter4_response2.txt eureka.log reward_code_eval4.txt

claraadam commented 7 months ago

Same issue here, did you solve it ?

sihany077 commented 5 months ago

Evaluation metrics for different tasks can be found in the environment code, along with their calculation methods.