VinF / deer

DEEp Reinforcement learning framework
Other
485 stars 126 forks source link

MG example with custom environment #90

Closed ciolo closed 3 years ago

ciolo commented 3 years ago

Hi, first of all congratulations, interesting repo. I would like to use the MG example by modifying the environment a bit. In particular, in my case there is no long-term storage, but only the battery (and obviously also consumption and production). I also have historical data about the energy storage system (kwh) of a building and would like to integrate them into the environment. Can you help me?

VinF commented 3 years ago

Hi,

If you simply remove the long-term storage as compared to the MG example, then the action space is unnecessary. You just have a rollout by storing the excess of energy whenever you can (until full) and by taking energy out of the battery whenever necessary (until empty). In you case, what would be the action space and what would it try to optimize?

ciolo commented 3 years ago

Hi, thanks for the quick reply. I've various expected outcomes, like RES optimization, storage optimization and energy savings. The space of actions could be vast, such as consuming or storing the energy produced, consuming or storing energy from the grid, etc.

VinF commented 3 years ago

Indeed it seems that the MG example should be a good starting point.

ciolo commented 3 years ago

Yes thanks. Another question: I have my own space for actions, such as:

VinF commented 3 years ago

I'm unsure about you specific question and setting but you will likely get your answers here: https://ewrl.files.wordpress.com/2016/11/ewrl13-2016-submission_21.pdf.

ciolo commented 3 years ago

Great, thanks!