search

duolicious / duolicious-backend

The backend of the Duolicious dating app
https://duolicious.app
GNU Affero General Public License v3.0
40 stars 8 forks source link

A solution to scraping #295

Open SabreBleu opened 2 weeks ago

SabreBleu commented 2 weeks ago

In case you haven't seen yet, the data on the site is being mass scraped. 4chan's /g/entoomen made a scraper : https://duoleak.acid.im/ & a team of social science researchers from the EU also used one : https://archive.org/details/duolicious_analysis/mode/1up . Tbf, its just things you put on your public profile and even Tinder has struggled fighting scrapers. Hindering and getting rid of these bots could not only clear the honeypot allegations but also would marginally improve performance.

duogenesis commented 2 weeks ago

Working on it in https://github.com/duolicious/duolicious-backend/pull/296

duogenesis commented 2 weeks ago

Will be closed by #300 and #296