Task metadata

[tekumara]

It would be nice to be able to store arbitrary task metadata surfaced somewhere like under task information:

In our case we'd store the version numbers of different packages, who ran the eval, and a hostname.

[aisi-inspect]

Interestingly we have a metadata field in the EvalSpec (which is what this is drawing from) but no way to populate it! I wonder if should add a metadata field to Task and forward it here? (@dragonstyle LMK what you think)

[tekumara]

If what were displayed here were the task args, that would be swell and probably work well! As these are used to pass to the solver and define what runs and so worth surfacing in and of themselves. We could also use them to capture additional metadata.

[jjallaire]

@dragonstyle Don't we at least try to display the task_args? If we don't then we absolutely should (even if the are also displayed in config above)

[dragonstyle]

We are displaying task_args on the 'Info' tab (we render this metadata, so it should render simple values, but also things like dictionaries or arrays). Are you not seeing a 'Task Args' section (if you aren't, I should try to reproduce and figure out why!)?

[tekumara]

Yeh unfortunately I'm not seeing a Task Args section at all on the Info tab.

[dragonstyle]

Sorry to have let this languish! That section definitely should be present...

• Could you share the inspect version that you're using (inspect --version from the terminal)?
• If possible is there a sample log that you'd be able to share (I can share my email address if you'd rather not post)?

Thanks and sorry for the issue...

[tekumara]

Huh, I can't seem to reproduce this anymore. Happy to close this, sorry for the bother!

[dragonstyle]

Ok thanks for the followup and glad it appears to be working again!