-
❯ docker build -t selenium-grid .
[+] Building 1.3s (6/6) FINISHED docker:des…
-
Provide me plan or ideas how you can improve the code for use it on large scale
Checklist
- [X] Create `src/url_manager.py` ✓ https://github.com/Hardeepex/webscraper/commit/54e588e7a9b0a8442c3c20b…
-
Can you add the feature of selenium grid
Checklist
- [X] Create `src/selenium_grid.py` ✓ https://github.com/Hardeepex/webscraper/commit/7e760ad71401d97d4064a53608378bb52a535125 [Edit](https://gith…
-
import scrapy
from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
from selectolax.parser import HTMLParser
from yourproject.items import YourI…
-
### Details
❯ docker build -t selenium-grid .
[+] Building 64.5s (6/6) FINISHED …
-
### Current Behavior
I was attempting to use the [API](https://scrapoxy.io/integration/api-reference), but I believe I'm missing something. I grabbed username/password from the Project Settings and t…
-
### Details
This is the webscraping code
import httpx
from selectolax.parser import HTMLParser
import time
def get_html(baseurl, page):
headers = {
"User-Agent": "Mozilla/5.0 (X1…
-
### Self Checks
- [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones.
- [X] I confirm that I am using English to…
-
Since there is no dedicated API for these platforms - CodeChef, AtCoder and LeetCode, I want someone to use Web-Scraping to fetch the contest data (next 4 contests, their date and timing) everytime I …
-
Basically codeclock.html contains the date and time of upcoming contests on Codeforces, Atcoder, Codechef and Leetcode.
I want someone to automate this process:
The process:
1) Fetch details o…