Implement real world scenorio

Hello,

Very cool git repo! In my real world work, (nothing to do with coding with Python) I am an HVAC controls technician where I setup PID controllers for different types of HVAC systems. The software (across the industry) I use is very 'canned' (cookie cutter) with ladder type logic. Anyway I have been learning a little bit about RL on the side mostly as a hobby, as well as Python...

From reading your repo about the lessons learned you state that model based RL would be a place to start...? Could you please help me get started at all with what you have done thru your git repo?

I am familiar with a python package called BAC0 written for the BACnet stack (protocol used for building automation vendors to communicate with each other) and I have alot of spare parts laying around. On a test bench I have a PID controller setup where I know I can make a script to build a dataset which I think would be similar to the simulations script you have.

Ultimately I am hoping to setup on a test bench an experiment with a PID controller, where the controller would have a 2 temperature sensors (ambient air temp, hot water temperature) wired to it and the PID output would energize a relay to heat a pot of water to a setpoint.

Sorry for the long post here, but would this be a good place to start if I have a days worth of data on like 5 minute intervals of the PID maintaining a temperature setpoint? Also hoping for some sort of power usage calculation of the electric heating element. Could I modify something from your repo from here?

Thank you for anytime you have in response. I was super surprised to find someone already has a git repo for what I have been day dreaming about..!

Ben

tilkb / thermoAI

Implement real world scenorio #2