search

clemlesne / scrape-it-now

Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.
Apache License 2.0
492 stars 16 forks source link

Couple of issues during dev install #14

Closed khakimov closed 2 months ago

khakimov commented 3 months ago
clemlesne commented 3 months ago

1. .python-version points at scrapeitnow312 which doesn't exist on the system (should it be 3.12.4?)

Personally (that's a matter of personal preference), I use pyenv with a virtualenv named for my project. You can create like that:

pyenv virtualenv 3.12 scrapeitnow312

2. pip install pip-tools required since using pip-sync not possible without

The command make install actually does install pip-tools:

https://github.com/clemlesne/scrape-it-now/blob/5abe9edfe7add85be56c60f3196105a7e2c50b1d/Makefile#L28-L39

Can you share your logs to reproduce your issue?

clemlesne commented 2 months ago

Closing this after 3 weeks. Don't hesitate to re open if needed.