use headless Chrome to browse_url

Cormanz / smartgpt

A program that provides LLMs with the ability to complete complex tasks using plugins.

MIT License

1.76k stars 127 forks source link

Closed jaykchen closed 1 year ago

jaykchen commented 1 year ago

headless Chrome to allow js and make it possible to properly "read" much of today's webpages
capture webpage in pdf format virtually, aiming to get what human eyes see
use poppler-rs library to get text content from the "pdf file" in memory note: poppler-rs currently tested to work on Linux only