Expected behavior
Journal article urls are collected and searched through for figures.
Outputs
Just a moment... Please turn JavaScript on and reload the page. Checking your browser before accessing onlinelibrary.wiley.com. Please enable Cookies and reload the page. This process is automatic. Your browser will redirect to your requested content shortly. Please allow up to 5 seconds… Redirecting… DDoS protection by Cloudflare Ray ID: 6f4c0f528d116326
Environment (please complete the following information):
Using Docker
Python version 3.9.9
Additional context
This may require converting the Wiley scraper to be a dynamic one using selenium like RSC or other methods to avoid bot detection.
Describe the bug Wiley scraper fails to return anything.
To Reproduce Steps to reproduce the behavior:
run.py
Expected behavior Journal article urls are collected and searched through for figures.
Outputs Just a moment... Please turn JavaScript on and reload the page. Checking your browser before accessing onlinelibrary.wiley.com. Please enable Cookies and reload the page. This process is automatic. Your browser will redirect to your requested content shortly. Please allow up to 5 seconds… Redirecting… DDoS protection by Cloudflare Ray ID: 6f4c0f528d116326
Environment (please complete the following information):
Additional context This may require converting the Wiley scraper to be a dynamic one using selenium like RSC or other methods to avoid bot detection.