search

fake-name / xA-Scraper

69 stars 8 forks source link

TwitGet: Check if join dates match #89

Open God-damnit-all opened 4 years ago

God-damnit-all commented 4 years ago

Sometimes people change their twitter handle or delete their account. As if that wasn't bad enough, sometimes someone else starts using the same handle.

Sometimes users even go back to their old handle after realizing being on their new handle is causing confusion.

My thinking is that a migration should be put into effect where their join dates are appended to their folder name and their database entry, in brackets (since you cannot have brackets in your twitter handle) with the format [YYYYMMDD]. That way the only collision will be if someone takes over the same handle with the exact same join date.

You could also use some sort of internal ID that probably exists in the Twitter API somewhere if that slim chance of a collision is an issue, but the join date is the more intuitive option.

fake-name commented 4 years ago

Twitter recycles names? Fuuuuck.

God-damnit-all commented 4 years ago

@fake-name I take it back, I think finding the internal ID for Twitter users is going to be necessary after all, due to retweets... if the username behind a retweet is changed, the retweet persists but xA-Scraper is going to think the source is different.

What a fucking mess Twitter is.

Honestly I think the way to go is going to be migrating the data over to the internal user id, including renaming the directories. With the structure the way it is, I have to use a file indexer to find stuff anyway, so it won't be any major loss.

God-damnit-all commented 4 years ago

Twitter recycles names? Fuuuuck.

You ok? Did this revelation kill you?

fake-name commented 4 years ago

No, I've just been super busy with other projects.

If you wanna hear more then anyone should need to know about debugging modbus-RTU over a pseudo open-collector shared serial bus, I'm your man at this point.