Bottlenose should be able to send a job to Orca with the requisite execution information, priority, response information, and more. It should then be able to take in a response, verify it is coming from the correct source, and then record its output to be compared to its current output later on.
Solution
Grading job creation with file URLs, a grading script to be executed on a worker, queue information, and response information.
New response route that saves the complete logs and output (if available) from Orca.
Secret handling as a source of authentication to ensure no bogus files are created.
Problem
Bottlenose should be able to send a job to Orca with the requisite execution information, priority, response information, and more. It should then be able to take in a response, verify it is coming from the correct source, and then record its output to be compared to its current output later on.
Solution