UKGovernmentBEIS / inspect_ai

Inspect: A framework for large language model evaluations
https://UKGovernmentBEIS.github.io/inspect_ai/
MIT License
385 stars 41 forks source link

Inspect view is missing column headers #38

Closed tekumara closed 3 weeks ago

tekumara commented 3 weeks ago

After checking out the repo at commit 0a684c6 and running:

inspect eval examples/security_guide.py --model bedrock/meta.llama2-70b-chat-v1
inspect view

Then navigating to http://localhost:7575/ I see a page without the column headers:

CleanShot 2024-06-08 at 16 33 49@2x

The docs has this image with column headers Input, Target, Answer, Score:

jjallaire commented 3 weeks ago

cc @dragonstyle

dragonstyle commented 3 weeks ago

Thanks for reporting this! We're in the process of moving our sample listing to a model that better supports large number of samples and the column headers disappeared during this transition. They will return in our next release!

aisi-inspect commented 3 weeks ago

Resolved with this commit: https://github.com/UKGovernmentBEIS/inspect_ai/commit/8141ef25f2eef2cb23c8ac8a4d2ee02872db6549