Add support for retrieving info about experiment progress

[GoogleCodeExporter]

Add some way to see/measure how the experiment is going.

Show some measure of performance/error.

Original issue reported on code.google.com by ricardok...@gmail.com on 28 Jun 2009 at 11:59

[GoogleCodeExporter]

Original comment by ricardok...@gmail.com on 29 Jun 2009 at 12:02

• Added labels: Priority-Critical
• Removed labels: Priority-High

[GoogleCodeExporter]

im not sure we can do this in a way thats good enough for all types of
experiments/agents/environments. We should figure out what support we need to 
build
to make this easy.

Original comment by lucio.to...@gmail.com on 29 Jun 2009 at 12:19

[GoogleCodeExporter]

I guess this would consist of a two level of support:

1. support all common attribute querying in a common and easy way (retrieving 
number
of steps executed for each episodes, number of episodes run, total reward 
achieved,
the mapping/policy achieved after each episode -- if this makes sense for 
anything, etc)

regarding obtaining the mapping/policy, there is already support for this. 
regarding
number of episode/number of steps per episode/total reward, there is already 
support
for that in rlglue -- we might look at it

2. support custom information lookup.

this would probably be made by means of sending messages between the experiment 
and
the environment/agent, but we may be able to define an easy and simple API for 
it.

Original comment by ricardok...@gmail.com on 29 Jun 2009 at 12:52