VisionEval / VisionEval-Dev

Development version of VisionEval framework
https://visioneval.github.io/
Apache License 2.0
6 stars 32 forks source link

Debug Intermediate Values During Model Execution #188

Closed jrawbits closed 1 year ago

jrawbits commented 2 years ago

Create a module that copies a Datastore field to a new field with a new name. Use that module within models to take a snapshot of fields in the Datastore. Intended for use with things like DVMT that get overwritten by different modules so intermediate values can be identified.

Basic strategy is simple, but needs to allow for iterations in loops (like standard VEState/VERSPM) so results from each loop can be identified - that will require framework modification.

jrawbits commented 1 year ago

This is in the pipeline along with Dynamic Module specifications.

jrawbits commented 1 year ago

New framework VESnapshot module and supporting framework changes provide this functionality.