RLGC-Project / RLGC

An open-source platform for applying Reinforcement Learning for Grid Control (RLGC)
Other
111 stars 31 forks source link

RLGC project code structure #17

Open LeZhengThu opened 3 years ago

LeZhengThu commented 3 years ago

Dear Qinhua, I was always struggling to connect the power system simulation tool (like PSAT, BPA) to a public available RL environment like Gym. Your work was amazing. I'd like to know the boundary of the project, mainly on the power system simulation part. To be more specific,

  1. Does the project support electromagnetic transient simulation?
  2. If I'd like to run RL on my own power networks, what part of the case files should I change? And do the model definition files have any documentation to guide me if I want to build my own power network model?
  3. I figure out that the functions you mentioned in Section III.B of your trans paper, like initStudyCase, applyAction, nextStepDynSim were all written in Java in the folder /org/pnnl/gov/pss_gateway. Are the Java files the bridge to connect the RL environment and the power system simulation software? Do you contain the power system simulation software in the repo?
  4. If I'd like to have more actions or build my own rewards, what codes should I change? Are those Java files used to define the actions and rewards?

Thank you again for the great benchmark.

LeZhengThu commented 3 years ago

Besides, does the *.jar files in the folder lib contain InterPSS? Where does the power system simulation carry out? I'd like to know more about the power system simulation part so that I can alter that part for my own studies. Thanks.