Open spraot opened 2 years ago
I'm just somebody interested in finding a good airbnb :) All the code I found is public in this repo and its forks.
Also if there's a way to run the scraper locally I would love to avoid making all these small commits to test things.
I'm just somebody interested in finding a good airbnb :) All the code I found is public in this repo and its forks.
Also if there's a way to run the scraper locally I would love to avoid making all these small commits to test things.
Hi @rachetfoot 👋
Maybe you've already found out but there definitely is a way to run the scraper locally. You can use Apify CLI tool: https://docs.apify.com/cli
For each Apify actor you clone from GitHub, run apify init
and npm install
from the root directory. apify init
command initializes apify_storage
directory where you can find the INPUT.json
file under key_value_stores/default
. The results will be stored to datasets/default/*.json
. To run the scraper, use apify run -p
(-p
flag ensures that the state from the previous run is cleared properly).
You can also push your local code directly to the Apify platform using apify push
command. This way, the source files will be stored on the platform and the changes won't go through GitHub at all.
Hello @rachetfoot , thanks for the PR. May I ask who are you and where you found the code done by @wmatex ? Thanks for the clarity.