Devise baseline comparison mechanism - Githubissues

ShortestPathLab / posthoc-app

Posthoc is a way to build simple and effective visualisations ✨ for sequential decision-making algorithms, such as search.

http://posthoc-app.pathfinding.ai/

28 stars 5 forks source link

Devise baseline comparison mechanism #16

Open francisanthony17 opened 11 months ago

francisanthony17 commented 11 months ago

Comparison with a known good baseline is crucial to many debugging workflows.

Currently, comparison is achieved through toggling a layer on and off to visualise differences - a sort of hack. Baseline is another search trace.

Proposal workflow:

Load baseline trace
Load current algorithm trace
Set breakpoint to first difference (with reference to baseline trace)
Playback trace (or jump to next breakpoint)
When breakpoint is hit, explore viewport to see differences

Other comparison nice-to-haves:

Jump to nodes unexpanded by the baseline but expanded by the current algorithm
Jump to negative costs