Adding js reverse engineering functionality?

mishushakov / llm-scraper

Turn any webpage into structured data using LLMs

MIT License

2.42k stars 147 forks source link

Adding js reverse engineering functionality? #13

Closed Tyson-Che closed 5 months ago

Tyson-Che commented 7 months ago

Is it possible to teach LLM to use the dev tools, analyse the network panel and figure out the structure of the web?

mishushakov commented 5 months ago

Possible, but not practical. What's practical is figuring out the structure of the webpages, generating crawl script and self-healing it so it works reliably