First off - thanks a bunch for making this script available. Very helpful.
The scraper looks to be working fine however I'm unable to figure out where the csv file containing the scraped data is located on my machine. Due to environmental issues i'm running the script through my IDE. Any thoughts?
from selenium import Chrome
from selenium import webdriver
from instascrape import Profile, scrape_posts
import csv
First off - thanks a bunch for making this script available. Very helpful.
The scraper looks to be working fine however I'm unable to figure out where the csv file containing the scraped data is located on my machine. Due to environmental issues i'm running the script through my IDE. Any thoughts?
from selenium import Chrome
from selenium import webdriver from instascrape import Profile, scrape_posts import csv
Creating our webdriver
options = webdriver.ChromeOptions() options.add_argument("")
Path to your chrome profile
w = webdriver.Chrome("/usr/local/bin/chromedriver", options=options)
Scraping JT's profile
SESSIONID = '' headers = {"user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 " "KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36", "cookie": "sessionid=;"} jt = Profile("et_used_boards") jt.scrape(headers=headers)
Scraping the posts
posts = jt.get_posts(webdriver=w, login_first=True) scraped, unscraped = scrape_posts(posts, silent=False, headers=headers, pause=10)