apify / crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
https://crawlee.dev/python/
Apache License 2.0
4.02k stars 254 forks source link

feat: BasicCrawler.export_data helper #222

Closed janbuchar closed 3 months ago

janbuchar commented 3 months ago
janbuchar commented 3 months ago

the class ExportToKwargs - couldn't it be removed now?

No, it's still used in Dataset.export_to.