search

FerrenF / ProjectScrapeQuora

For getting questions and answers for quora.
0 stars 0 forks source link

update pls #1

Open heyeanne34 opened 4 months ago

heyeanne34 commented 4 months ago

Maxes out at about 100 questions. Need to beat that infinite scrolling scrape detection.

FerrenF commented 4 months ago

Hi there! Oh, god someone is actually using this.

Yeah, at a certain point anti-scrape measures were implemented that cause problems. To get a unique set of questions when you refresh, or to avoid a limit when scrolling down, Quora requires a user to be logged in. It complicates the idea of scraping questions off of Quora greatly, although... does not make it impossible.

I am a full-time college student, and constantly run into time crunches. There's a long story behind this paused project, but I intend to try and implement a solution for this over the summer. Perhaps check back later!