search

UKGovernmentBEIS / inspect_ai

Inspect: A framework for large language model evaluations
https://inspect.ai-safety-institute.org.uk/
MIT License
631 stars 118 forks source link

Web browser struggles with large pages #740

Open art-dsit opened 1 month ago

art-dsit commented 1 month ago

The browser tool gets hung up trying to process large text files e.g. https://www.gutenberg.org/cache/epub/100/pg100.txt

Example here https://github.com/UKGovernmentBEIS/inspect_ai/blob/browser_large_text/tests/tools/test_web_browser.py#L151

art-dsit commented 2 weeks ago

This also happens with large HTML pages such as https://www.gutenberg.org/cache/epub/100/pg100-images.html although it does actually get through it (it takes about 30 minutes to open the page and scroll down once)