Couchers-org / couchers

The next-generation couch surfing platform. Free forever. Community‑led. Non‑profit. Modern. Chuck us a star :)
https://couchers.org
MIT License
389 stars 79 forks source link

Support Couchsurfing Data Exports #4207

Open jpmonette opened 4 years ago

jpmonette commented 4 years ago

In order to speed up the creation of an Account on Couchers, I'd suggest to support the data export format that Couchsurfing is using to support things like:

Potentially, we could track external IDs of Couchsurfing friends and send a request if they ever join.

growthhack

lucaslcode commented 4 years ago

Good idea, do you have an example file?

lucaslcode commented 4 years ago

We can look at this to help: https://github.com/simison/couchspinner

jpmonette commented 4 years ago

I can dump it at some point & make a TypeScript definition if that helps.

Vinalti commented 3 years ago

That's pretty calm here. Did anyone work on this issue ? here is a test file I forged (anonymized) When downloaded it is in a zip file. For the sake of rapidity I removed some useless data to import (we cannot anyway trust the references, etc. as the user can modify that file by itself)

2001234567-202107280643.zip

svoop commented 2 years ago

From Couchers-org/couchers#2240:

At least for profiles behind the paywall, it's now possible to download the dump right after login on the paywall dialog (by clicking on the "manage account" link) and without the need to beg for it from CouchSurfing support:

Screenshot 2021-12-18 at 10 15 50

Screenshot 2021-12-18 at 10 16 01

and about 10 seconds later after reload (you get an email with the download link as well)

Screenshot 2021-12-18 at 10 16 42

kylebakerio commented 2 years ago

I take it no one is working on this issue? I also know references can't necessarily be trusted on their own--we could, though, give them as "ghost reviews" that are grayed out with a warning saying they could be fake, and allow the former user to confirm them if they were to sign up to couchers.

Starts to be non-trivial, but would be a "killer feature", as for people like me who had years of reviews, that's the most painful loss. Also, even if they were shown as non-trusted and grayed out, it would be nice to have them. They were a part of the memories I had collected on the platform.

HankAviator commented 2 years ago

The only way to make sure references not tempered in archive is to allow Couchers to download directly from Couchsurfing.com after consent from user, as no open api for authentication and data export is (amd will ever be) available from Couchsurfing. The challenge is legal stuff though.

kylebakerio commented 2 years ago

That's a nice solution.

what legal issue would there be here...? The data is owned by the user, not couchsurfing.

aapeliv commented 2 years ago

@kylebakerio: happy to assign you to this. Let me know if you need help getting started!

HankAviator commented 2 years ago

@kylebakerio mmm I might have thought too much. Although this gets close to automated extraction, but should be fine after clear, detailed consent. This may help users with a good profile and some references on Couchsurfing while even empty profile on Couchers to quickly get started.

kylebakerio commented 2 years ago

@aapeliv I have zero familiarity with this codebase, and this sounds like quite an undertaking. I would definitely need a lot of guidance to even begin approaching this, and I have enough open source contribs that I'm behind on as it is.

But laying out an overview of how one would approach it would be helpful to whoever starts it, whether that's me or someone else.