search

GaloisInc / csaf

Control Systems Analysis Framework - a framework to minimize the effort required to evaluate, implement, and verify controller design (classical and learning enabled) with respect to the system dynamics.
BSD 3-Clause "New" or "Revised" License
11 stars 4 forks source link

Design / Implement OpenAI Gym + CSAF integration #67

Closed podhrmic closed 3 years ago

podhrmic commented 3 years ago

In GitLab by @bauer-matthews on Sep 30, 2020, 07:26

podhrmic commented 3 years ago

In GitLab by @bauer-matthews on Sep 30, 2020, 07:27

@zutshi / @EthanJamesLew- I know you both have made progress on this already. Can one of you summarize current state and the proposed end state?

podhrmic commented 3 years ago

In GitLab by @zutshi on Sep 30, 2020, 09:41

Integration of OpenAI is split into:

1) exporting (CSAF components + required wrappers) to OpenAIGym 2) training (running the system in OpenAI Gym) 3) importing (trained component back into CSAF)

(3) Has been addressed by @EthanJamesLewin !44. We have to address (1) which is more complex and will require additional features on top of CSAF. I am in the process of fleshing it out, but we are not targeting it for next release unless the subs require it. (2) is under the control of OpenAIGym, and mentioned for completeness.

podhrmic commented 3 years ago

In GitLab by @podhrmic on Oct 1, 2020, 08:44

I changed the milestone to reflect @zutshi 's comment.

podhrmic commented 3 years ago

In GitLab by @bauer-matthews on Oct 1, 2020, 09:48

Let's open a new bug specific to point 1 under the test / verification alpha. And we can decided during the AA sync on 10/5 if we want to keep it there.

podhrmic commented 3 years ago

In GitLab by @EthanJamesLewon Oct 15, 2020, 12:58

mentioned in merge request !54

podhrmic commented 3 years ago

In GitLab by @EthanJamesLewon Oct 19, 2020, 10:14

Closing for now due to !54