cldellow / datasette-scraper

Add website scraping abilities to Datasette
Apache License 2.0
60 stars 1 forks source link

javascript interaction? #52

Open ar-jan opened 10 months ago

ar-jan commented 10 months ago

Could datasette-scraper be made to handle pages that require javascript interaction? (e.g. infinite scroll, clicking elements to load other parts of the page).

I've tested using playwright for this with just Python+SQLite, but am interested in moving to this project for some more structure and management for the scraping.