ExecExam is a powerful tool that runs executable examinations in which a student provides solutions to programming problems that are checked by Pytest test suites. If you are a computer science or software engineering instructor who wants to administer programming examinations
ExecExam uses the LLM-based advice system to provide students with feedback when one of their answers fails a check. You can either specify the complete URL of a LiteLLM API proxy or set an API key for a cloud-based LLM provider. Here are examples of some of the LLM models that are supported through the use of LiteLLM:
anthropic/claude-3-haiku-20240307
anthropic/claude-3-opus-20240229
groq/llama3-8b-8192
openrouter/meta-llama/llama-3.1-8b-instruct:free
openrouter/google/gemma-2-9b-it:free
Follow these steps to install the execexam
program:
pipx install execexam
to install ExecExampipx list
and confirm that ExecExam is installedexecexam --help
to learn how to use the toolIf you would like to contribute to Execexam, please refer to the Execexam Wiki for contributing guidelines.