search

apify / crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
https://crawlee.dev/python/
Apache License 2.0
3.96k stars 258 forks source link

Automatically install dependencies after bootstrapping a project via CLI #317

Open janbuchar opened 2 months ago

janbuchar commented 2 months ago

Currently we only support poetry, but it'd be beneficial to also have a "raw pip" flavor of the templates.

vdusek commented 2 months ago

Could you add pip/poetry versions of the templates as part of this issue as well?

souravjain540 commented 2 months ago

a BIG THANKS for this!

janbuchar commented 2 months ago

a BIG THANKS for this!

I mean, it is on the roadmap, but not yet finished by any means. Just to make it clear.

I understand you get a lot of questions about this, huh?

janbuchar commented 1 week ago

See: