UKGovernmentBEIS / inspect_ai

Inspect: A framework for large language model evaluations
https://inspect.ai-safety-institute.org.uk/
MIT License
565 stars 96 forks source link

Non-scrollable content when only one test case #47

Closed adrianlyjak closed 3 months ago

adrianlyjak commented 3 months ago

If there's only one one piece of data in the dataset, the inspect web view seems to open in a special mode. Normally there's a table and you can click into elements to view details. However with a single test, the details shows below the row. This makes sense, however the details view seems to not be scrollable with long content (missing some sort of overflow-y: auto).

image

Specifically, if I change that to overflow-y: auto from hidden, I can scroll, otherwise the container is not scrollable and content is clipped

adrianlyjak commented 3 months ago

I see there's some code that seems like it should be setting it to scrollable.

https://github.com/UKGovernmentBEIS/inspect_ai/blob/8141ef25f2eef2cb23c8ac8a4d2ee02872db6549/src/inspect_ai/_view/www/src/workspace/WorkSpace.mjs#L81

I did confirm I'm on the latest released version

inspect --version
0.3.14

https://github.com/UKGovernmentBEIS/inspect_ai/commit/0c77feab2f11f75980403ce00adb0ca02b4bd463#diff-0b4b6031b5d6f309f5dde139c9e0def5010ebc3a38e4129d3a357d7c89d44670

Looks like this perhaps has just not been released yet. 0.3.14 is before that commit

aisi-inspect commented 3 months ago

Yes, we are release 0.3.15 later today. In the meantime you can install with:

pip install git+https://github.com/UKGovernmentBEIS/inspect_ai