May I ask you for how to start this project?

[Arashiailing]

I had read your paper Learning Intrusion Prevention Policies through Optimal Stopping, and have some problems,such as the defender policy against NOISYATTACKER and STEALTHYATTACKER, I don't know how it works. And your code import gym_pycr_ctf but I can't find this function

[Limmen]

Hi @Arashiailing.

Unfortunately this project is not actively updated. I plan to release the latest code base for the extended version of the paper (see https://ieeexplore.ieee.org/document/9779345) soon.

If you just want to get started with reinforcement learning and cyber security, I recommend: https://github.com/Limmen/gym-idsgame

[Arashiailing]

Thanks for you reply, I'm learning gym-idsgame now. Your'code are very professional and I learned a lot. I hope someday I will be a man like you, and finally have a good day!

---Original--- From: "Kim @.> Date: Wed, Nov 16, 2022 21:48 PM To: @.>; Cc: @.**@.>; Subject: Re: [Limmen/gym-optimal-intrusion-response] May I ask you for how tostart this project? (Issue #2)

Hi @Arashiailing.

Unfortunately this project is not actively updated. I plan to release the latest code base for the extended version of the paper (see https://ieeexplore.ieee.org/document/9779345) soon.

If you just want to get started with reinforcement learning and cyber security, I recommend: https://github.com/Limmen/gym-idsgame

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

[ybello02]

Hi Kim,

I'm trying to work on your csle framework (https://limmen.dev/csle/) that was recently made public for one of my research work. It seems I can't git clone the framework. Just wondering if I'm doing anything wrong from the installation guide or the source code of the framework is not yet made public.

Thanks a lot. I really appreciate your work.

[Limmen]

Hi @ybello02,

Thanks for your interest in CSLE. The framework is currently in a beta release, going through some tests. We will soon release the code to the public, I will let you know.

Best/Kim

[ybello02]

Hi Kim,Thank you for your quick response. I will keep an eye on the release of csle.A quick question, can I use the traces you provided from the emulation environment to run the gym-optimal-intrusion-response game environment. I clone the code but when I run the runner.py, it keeps throwng back errors of missing modules (gym_cfr) from gym.Best,Yahuza.On May 4, 2023, at 2:25 AM, Kim Hammar @.***> wrote: Hi @ybello02, Thanks for your interest in CSLE. The framework is currently in a beta release, going through some tests. We will soon release the code to the public, I will let you know. Best/Kim

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>

[Limmen]

You are welcome. This repository is not actively maintained, I think it is not much work to fix the issues it seems just to be about some library conflicts but I won't keep this library up-to-date.

You can use this library instead, it is based on the same publication and I just tested it and it works: https://github.com/Limmen/optimal_stopping_pomdp

To use it, run the following commands:

git clone https://github.com/Limmen/optimal_stopping_pomdp cd optimal_stopping_pomdp pip install -e . cd examples python ppo.py

BR/ Kim

[ybello02]

Thank you very much Kim. I really appreciate it. I will try the suggested library.Best,Yahuza.On May 4, 2023, at 6:46 AM, Kim Hammar @.***> wrote: You are welcome. This repository is not actively maintained, I think it is not much work to fix the issues it seems just to be about some library conflicts but I won't keep this library up-to-date. You can use this library instead, it is based on the same publication and I just tested it and it works: https://github.com/Limmen/optimal_stopping_pomdp To use it, run the following commands: git clone https://github.com/Limmen/optimal_stopping_pomdp cd optimal_stopping_pomdp pip install -e . cd examples python ppo.py BR/ Kim

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>

[ybello02]

Hi Kim,

Thanks for the suggestion. I run the optimal stopping game and it works using the PPO. After it finishes running, it does not save the results in the .zip file that it was supposed to. Do I have to specify the save dir in the ppo.py code for that?

Thanks for your help.

Best, Yahuza.

On Thu, May 4, 2023 at 6:52 AM Yahuza Bello @.***> wrote:

Thank you very much Kim. I really appreciate it. I will try the suggested library.

Best, Yahuza.

On May 4, 2023, at 6:46 AM, Kim Hammar @.***> wrote:



You are welcome. This repository is not actively maintained, I think it is not much work to fix the issues it seems just to be about some library conflicts but I won't keep this library up-to-date.

You can use this library instead, it is based on the same publication and I just tested it and it works: https://github.com/Limmen/optimal_stopping_pomdp https://www.google.com/url?q=https://github.com/Limmen/optimal_stopping_pomdp&source=gmail-imap&ust=1683802013000000&usg=AOvVaw3BW9oJkwbzHBvhFtA5viyM

To use it, run the following commands:

git clone https://github.com/Limmen/optimal_stopping_pomdp https://www.google.com/url?q=https://github.com/Limmen/optimal_stopping_pomdp&source=gmail-imap&ust=1683802013000000&usg=AOvVaw3BW9oJkwbzHBvhFtA5viyM cd optimal_stopping_pomdp pip install -e . cd examples python ppo.py

BR/ Kim

— Reply to this email directly, view it on GitHub https://www.google.com/url?q=https://github.com/Limmen/gym-optimal-intrusion-response/issues/2%23issuecomment-1534537526&source=gmail-imap&ust=1683802013000000&usg=AOvVaw3Gmy4IX8qeiGe8uqIC63hw, or unsubscribe https://www.google.com/url?q=https://github.com/notifications/unsubscribe-auth/ANNLB6DRPWO4756PJXVLAKTXEOCJZANCNFSM6AAAAAAR7PO354&source=gmail-imap&ust=1683802013000000&usg=AOvVaw3G26TC1ytOpBZhg-vrcW3Z . You are receiving this because you were mentioned.Message ID: @.***>

[Limmen]

Documentation for PPO is available here: https://stable-baselines3.readthedocs.io/en/master/

Best,

Kim

[ybello02]

Thanks for your feedback. Appreciated it.Best,Yahuza.On May 4, 2023, at 11:08 AM, Kim Hammar @.***> wrote: Documentation for PPO is available here: https://stable-baselines3.readthedocs.io/en/master/ Best, Kim

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>