anidata / ht-etl

Anidata 1.0: ETL and algorithm code.
0 stars 10 forks source link

Create site agnostic account ID parser #19

Open bmenn opened 6 years ago

bmenn commented 6 years ago

Currently, Backpage use an "OID" field to specify account IDs (or something analagous) to associate accounts with each post. This needs to be adapted in a similar fashion to the recent changes to email and phone number parsing. This include the ability to handle account IDs from various sites, not only just Backpage.

Examples of other sites to come soon.