Given a code snippet, the model should be able to trace through the computation to compute the final result or return value. This task ensures the model can semantically execute code.
Example
If I call the following snippet with the value, `x`, what will it return?
<code snippet>
Return:
Additional Notes
NOTE: This may be very difficult to do without CoT.
🚀 The Task
Given a code snippet, the model should be able to trace through the computation to compute the final result or return value. This task ensures the model can semantically execute code.
Example
Additional Notes
NOTE: This may be very difficult to do without CoT.