search

austinoboyle / scrape-linkedin-selenium

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
MIT License
454 stars 162 forks source link

Firefox support for CLI #15

Closed chankeypathak closed 6 years ago

chankeypathak commented 6 years ago

Need to add Firefox support.

chankeypathak commented 6 years ago

How can I specify below to use Firefox?

from scrape_linkedin import ProfileScraper

with ProfileScraper() as scraper:
    profile = scraper.scrape(user='chankeypathak')
print(profile.to_dict())
austinoboyle commented 6 years ago

You can use Firefox with the Python package by passing a custom driver into your Scraper instance. eg

from scrape_linkedin import ProfileScraper
from selenium.webdriver import Firefox

with ProfileScraper(driver=Firefox) as scraper:
    # profile = scraper.scrape(user='austinoboyle')
    # ...your code here

There is currently no support for the command line utility, which is something we could add.

chankeypathak commented 6 years ago

Thanks. I'll see if I can work on it this week.