search

willcrichton / awap

#startuptycoon
http://acmalgo.com
0 stars 0 forks source link

loading graph from file + deterministic RNG #14

Open chrisying opened 8 years ago

chrisying commented 8 years ago

Ideally we have a file containing the graph info + the seed used to generate the requests. We could provide a couple test maps/seeds and then use a different one for the real competition.

My current idea is to make the graph that is used be call "default.graph" and let the user rename the graph files appropriately to change between graphs. If anyone has a better idea, feel free to comment.

In fact, the graph file can include all the variables that we are changing around: like starting money, likelihood of a request, etc...

chrisying commented 8 years ago

Basic prototype of it (just graph parsing, very crude) on my branch chris-dev.

dlareau commented 8 years ago

How would this fit in with the fact that code will be uploaded for evaluation, would they also upload the graph file they want it evaluated with?

chrisying commented 8 years ago

Well they can locally test it with any setting file they want. They upload only their code and it runs against our preset(s). It's entirely possible we could keep the graph the same for both testing and competing but just vary the RNG seed so that request coming in with different values.

chrisying commented 8 years ago

I just thought about a potential issue. If we keep the RNG seed local, competitors could potentially simulate the entire game (they have the code already) and make an "optimal" decision. Likely, it'll still be an approximation but it would no longer be an online algorithm.

We should probably keep the random generation server-side (Autolab). Is that easily doable? Is there some way to also let the user locally test?