-
To do:
- Scraper - maintenance
- Document the data level in the article tag, how it got there, how persistent it is, and its use and benefits. (https://github.com/WebOfTrust/WOT-terms/issues/139)
…
-
As of now, the previously scraped data is stored in a text file. This needs to be updated by running the scraper and updating this info, or having it run when the user launches the application.
-
C:\Users\Diya Guha Roy\Desktop\Articles\Netnography 1\data>scraper.py -h
Traceback (most recent call last):
File "C:\Users\Diya Guha Roy\Desktop\Articles\Netnography 1\data\scraper.py", line 6, in…
-
As an alternative to directly uploading data to the portal, data can be loaded via the ckan api. Combining that with AWS lambda, we can write scapers to continuously push new data.
Note: AWS Lambd…
-
I run my code on python3 using the following:
```
$ .venv/bin/python -m congressionalrecord.cli 2001-01-06 2020-12-31 json
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py…
-
![cf-verifying](https://github.com/user-attachments/assets/39af8c34-02dc-4631-82bc-25cfe9089e67)
I'm trying to access a site thats cloudflare protected with the "Are you human?" page. I used cf-cle…
-
# Data Sources for Scraper
## Background
We need a list of youtube channels to scrape from
## Requirements
List 10 youtube channels below
## Example input
1. [Channel1](linktohere.com)
2.…
-
When a scraper is set in the task queue I want to track the progress and see when its run. Now only the `status` in the `Scraper` object is available, however this does not give enough information abo…
-
Hi, i tried the example code to see if the scraper works but it always return a validation error for attribute `top` which is supposed ton be an array.
here are my example code, a bit tweaked to u…
-
ScraperFC version: 3.1.0
Selenium version: 4.23.1
As normal, I import ScraperFC, initialize the Capology scraper per the documentation, and attempt to scrape EPL data from 2023-24. The result is a…