Open lahwaacz opened 1 year ago
Thanks @lahwaacz for reporting this issue.
After some inspection, it seems intentional that using the validate
button only return errors on grade cells.
There is even an option to validate the whole notebook, c.Validator.validate_all = True
(default to False
).
I don't have the history of these choices...
Steps to reproduce the actual behavior
For example, give students this assignment (I'll omit the description as it is self-explanatory):
Let's assume just one simple public test case:
Let's say that a student changes the cell with the assignment as follows:
Now there is an issue: when the student clicks on the "Validate" button in JupyterLab to validate their assignment, nbgrader executes it just fine and says that the solution passes all the tests. However, when the instructor runs autograde, it fails with the following error:
Expected behavior
Validate and autograde should behave consistently with respect to the
input()
function: either both should succeed, or both should fail with the same error.Operating system
Arch Linux
nbgrader --version
jupyterhub --version
(if used with JupyterHub)jupyter notebook --version
jupyter lab --version