techwithtim / AI-Web-Scraper

An AI web scraper using ollama, brightdata, selenium and other libraries.
257 stars 110 forks source link

Generate source code to scrap #3

Closed kripper closed 3 weeks ago

kripper commented 2 months ago

Using LLM inference each time is too expensive. Please support generating webscrapping source code for python.

Consider using some existing code interpreter as a library, like Aider, MetaGPT, AutoCodeRover, etc.

fukemy commented 3 weeks ago

do it by your self please