Details of exploration, verification, or exploitation。

[yijieZengz]

Hello, author. Thank you for your excellent work. I have two questions that I would like to get answer from you. Question1: how can I know which of exploration, verification, or exploitation is being performed at the current timestep? Question2: When performing one of exploration, verification, or exploitation, how are the corresponding long-term goals specified? Thank you again for your kind response, and I appreciate your outstanding work.

[XiaohanLei]

https://github.com/XiaohanLei/IEVE/blob/32efac4d6352f8d3b3ff14376c042470814e1c63/agents/instance_exp.py#L530

You can check the code here. instance_discriminator will generate new goal map (exploration, verification, exploitation) based on current observation.