mishushakov / llm-scraper

Turn any webpage into structured data using LLMs
MIT License
2.41k stars 147 forks source link

Use LLM without Playwright #15

Open luminous8 opened 7 months ago

luminous8 commented 7 months ago

Thanks for this, it's really good!

is there a way to send raw html of a page instead of using playwright to scrape a page and ask the llm to extract the content?

mishushakov commented 7 months ago

On my list 😉

luminous8 commented 4 months ago

👋 Any update on this?

mishushakov commented 4 months ago

Currently not, but you can use generateAISDKCompletions function from models.ts

jenslys commented 2 months ago

+1