search

UCL-INGI / INGInious

INGInious is a secure and automated exercises assessment platform using your own tests, also providing a pluggable interface with your existing LMS.
http://www.inginious.org
Other
202 stars 139 forks source link

Use the job wall clock timeout for time limit estimation #987

Closed mpiraux closed 7 months ago

mpiraux commented 9 months ago

By default the CPU time is used, which is not a real time metric. Using it to provide user feedback on job completion is not appropriate in multi-core environments.

nrybowski commented 9 months ago

Not sure of the behavior of this metric in virtualized environments. It could be worth to perform some comparisons.

mpiraux commented 9 months ago

image image Context for this PR

anthonygego commented 7 months ago

There is no optimal solution to this issue right now. The wall time is better for multithreaded projects because it is always larger than the running time. However, for most monothreaded projects (and the most common exercise type), the value is far away from the reality.

I think you should keep track of this issue in #989 for later in order to provide a better time estimation.