Future-Power-Networks / MAPDN

This repository is for an open-source environment for multi-agent active voltage control on power distribution networks (MAPDN).
MIT License
203 stars 55 forks source link

Problems in the experiment #30

Closed 2899567523 closed 10 months ago

2899567523 commented 10 months ago

Hi author, I have two small questions that I need you to answer for me. 1. I saw in your paper that the results are composed of the median and 25%-75% quantile shading, but I only see mean_test_totally_controllable_ratio in tensorboard. Is this the median? How to calculate the 25%-75% quantile? 2. How to compare with traditional control methods? I saw that droop control and OPF need to be implemented in matlab, so how to implement MARL? Looking forward to your reply!

hsvgbkhgbv commented 10 months ago

Hi,

Thanks for your interests!

  1. I saw in your paper that the results are composed of the median and 25%-75% quantile shading, but I only see mean_test_totally_controllable_ratio in tensorboard. Is this the median? How to calculate the 25%-75% quantile?

Answer: The 'mean_test_totally_controllable_ratio' indicates the average of the results of 10 episodes for one seed as written in the paper. The median is calculated over the 5 seeds at each timestep. As for how to calculate the 25%-75% quantile, please refer to https://numpy.org/doc/stable/reference/generated/numpy.quantile.html.

  1. How to compare with traditional control methods? I saw that droop control and OPF need to be implemented in matlab, so how to implement MARL?

Answer: We never say the traditional control methods are implemented for MARL. Droop control is more like a distributed control method, while OPF is more like a model-based control method.

Hope the answers are helpful!

2899567523 commented 10 months ago

Thank you for your answer, which means that I need to do 5 experiments, and then take the median and quantile of these 5 experiments as the final result, is it? The second question is how to reproduce the performance comparison of droop control , OPF and MARL in your paper? Drooping control and OPF can be obtained through MATLAB, but the result of MARL is not clear how to get it.

hsvgbkhgbv commented 10 months ago

Thank you for your answer, which means that I need to do 5 experiments, and then take the median and quantile of these 5 experiments as the final result, is it?

Yes.

The second question is how to reproduce the performance comparison of droop control , OPF and MARL in your paper? Drooping control and OPF can be obtained through MATLAB, but the result of MARL is not clear how to get it.

Please follow the instructions in https://github.com/Future-Power-Networks/MAPDN/blob/main/README.md#reproduce-the-results-in-the-paper.