hfurubotten / autograder

Automatic management and build tool for lab assignments. Moved to organization autograde: https://github.com/autograde
https://github.com/autograde
Other
14 stars 7 forks source link

ci: check output for fatal errors that should result in zero score #79

Open meling opened 7 years ago

meling commented 7 years ago

Currently, ci/deamon.go provides a check for

fatal error: stack overflow

This currently results in a zero score for the student, even though other parts of the student's code works correctly. This behavior is a feature to prevent students from submitting code with such severe failures. They should fix the problem first.

There are other types of error messages that should also give zero score. For example:

fatal error: all goroutines are asleep - deadlock!

However, these specific strings are Go specific.

Autograder should provide a language-specific list of error messages that should result in zero score for tests of that specific language. Different types of error messages are relevant for Java, Python and others.