search

agentos-project / agentos

The Python Component System (PCS) is an API and CLI for building, running, and sharing Python code. AgentOS is a set of libraries built on top of PCS that make it easy to build, run, and share agents that use Reinforcement Learning.
https://agentos.org
Apache License 2.0
13 stars 4 forks source link

Should agents contain environments or vice versa? #73

Open nickjalbert opened 3 years ago

nickjalbert commented 3 years ago

In our current model, an agent contains an environment:

agent_env2

This makes sense for implementation reasons, but (I think) this is the reverse of the intuitive way one would talk about these things (i.e. an agent performs behavior within an environment and an environment contains one or more agents).

This issue is a placeholder to remind us to discuss the tradeoff of modelling it the current way as opposed to the inverse way.

nickjalbert commented 3 years ago

Not sure if filing issues is a good way to track these "higher-level" discussions; @andyk let me know if you'd prefer some other approach (I could just keep a list for planning meeting or something).

andyk commented 3 years ago

Yeah an issue seems like a great way to track big picture things like this.

I agree that it is counter intuitive to have an agent contain an env and not vice verse.

It would be great to come up with a few concrete alternatives and then weigh the trade-offs between them.