On submit, prompt the baseliner to double-check their work

[sjawhar]

This will probably help a lot with avoiding data loss.

• "Do you want to run score before submitting?"
  • Only for tasks that support intermediate scoring
• Check if there's a git repo in /home/agent/solution.
  • If so, always prompt something like "Are you sure you've run committed and pushed your final changes?".
  • Stretch goal would be to detect uncommitted changes and untracked files and list them.

Unfair comparison to agents, that don't get this prompt?

[idavidrein]

This sounds great! (although it does make me feel a little sad we don't yet have automatic tracking so people don't need to remember to do this)

Also when is/isn't there a git repo in /home/agent/solution? I thought there now is always one but that seems wrong?

[sjawhar]

Tasks are responsible for making a git repo in /home/agent/solution. Currently that is only the case for AI R&D tasks, but only those tasks.