search

osrf / srcsim

Space Robotics Challenge
Other
9 stars 3 forks source link

Time limit for finals #246

Closed osrf-migration closed 7 years ago

osrf-migration commented 7 years ago

Original report (archived issue) by Vinayak Jagtap (Bitbucket: vinayak_jagtap).

  1. If we start multiple constellations, let's say 2, and run those in parallel. Will that be counted as double the time in the allowed 24 hours or is it counted as the actual time we used for those 2 constellations together?

  2. When we reset due to controller failure (#134, #161, #162, #164, #186, #206), how much time would we get back for resetting? Can it be the time we used from previous checkpoint completion to the failure point? I understand that the final deadline cannot be extended.

This information will help us plan our final runs better. Thanks.

osrf-migration commented 7 years ago

Original comment by Nate Koenig (Bitbucket: Nathan Koenig).

Available Hours

The original cloud simulation budget was 24 hours of AWS time. This assumed 1 machine and real-time performance. We have increased the machine count by one and the real time factor of simulation has dropped to 0.16.

So, we will scale the available AWS hours based on the original proportion of max_allowed_simulation_time_per_round to real_hours and also take into account the requirement of two machines.

One round has a maximum simulation time of 3.5 simulation hours, and there are 5 rounds.

p = (3.5 * 5) / 24 = 0.72917

Using a real-time factor of 0.16 the new ratio is

p_n = ((3.5/.16) * 5) / 24 = 4.55729

This is an increase by roughly a factor of 6.25.

Here is equality we solved for:

17.5 / 24 = 109.375 / allowed_hours allowed_hours = 150 hours

Including the 2 machines:

allowed_hours = 150 * 2 machines = 300 hours.

Reset

We will review your resets if you end up using all 300 hours, and still have rounds to complete. We will increase your time by the amount of time from the previous checkpoint to the point of reset.

osrf-migration commented 7 years ago

Original comment by Vinayak Jagtap (Bitbucket: vinayak_jagtap).

Thank you. This is much better than what I anticipated :)

osrf-migration commented 7 years ago

Original comment by Rud Merriam (Bitbucket: rmerriam).

Ah, this statement isn't from the "official" SRC competition group so be careful. I've emailed them for clarification.

osrf-migration commented 7 years ago

Original comment by dan (Bitbucket: dan77062).

I don't understand this at all. I thought we have only 24 hours of real time. In that case, using 2 machines with a sim time to real time factor of 0.16, then the most sim time we could possibly use is 24 2 .16 = 7.7 hours of sim time. And that is if you have 2 machines running for the entire 24 hours.

Are you saying we can use 300 hours of sim time? Even with two machines that would be 150 hours / .16 = 937 hours of real time (about 40 days.......)

Oh wait, are you saying this is AWS real time hours? In that case, keeping the window open over 4 days with 2 machines would take 192 hours of AWS time. Is that what you are talking about?

osrf-migration commented 7 years ago

Original comment by Vinayak Jagtap (Bitbucket: vinayak_jagtap).

@dan77062 The way I interpreted it is we have 300 AWS hours. but every 1 hour per constellation in real world costs us 2 AWS hours as there are 2 servers running.

osrf-migration commented 7 years ago

Original comment by Nate Koenig (Bitbucket: Nathan Koenig).

Right, you have 300 hours of AWS time. That equates to 150 hours of AWS when considering two machines are required for each constellation.

You can spend AWS time in parallel, if you want.

osrf-migration commented 7 years ago

Original comment by Jeremy White (Bitbucket: knitfoo).

It's official: https://ninesights.ninesigma.com/web/space-robotics-challenge/forum/-/message_boards/message/17422745