Per @mdietze request. Currently, sensitivity is binary on/off, but would be nice to be able to control which settings it uses.
Two off-the-cuff ideas related to this, #2406, and batch runs more generally:
Add a column like "settings_overrides" that is either formatted as inline JSON (or similar) or has a path to a JSON/YAML/XML file that contains specific settings that are not otherwise present in the CSV format.
Or more simply, just have a "settings_file" column that, if not NA, just contains a path to a XML file with information about the test and ignores every other field in that row.
Per @mdietze request. Currently, sensitivity is binary on/off, but would be nice to be able to control which settings it uses.
Two off-the-cuff ideas related to this, #2406, and batch runs more generally: