santhoshse7en / news-fetch

A Python Package which helps to scrape all news details from any news websites
MIT License
180 stars 109 forks source link

using selenium-hub? #7

Closed nareto closed 3 years ago

nareto commented 4 years ago

I'm trying to setup news-fetch on my server, where I already have two selenium docker containers [1], hub and standalone-chrome. I can get a working selenium.webdriver object like this:

from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities

huburl = 'http://seleniumhub_docker_container:4444/wd/hub'
driver = webdriver.Remote(command_executor=huburl, desired_capabilities=DesiredCapabilities.CHROME)

however I haven't been able to tell newsfetch to use this driver.

Is it at all possible or are there plans to acomodate this use-case?

[1] https://github.com/SeleniumHQ/docker-selenium

santhoshse7en commented 3 years ago

I haven't used Docker before, You can create a docker selenium file in the repo and test it. if it works fine. You can contribute to this project Thanks