kevinzg / facebook-scraper

Scrape Facebook public pages without an API key
MIT License
2.45k stars 633 forks source link

Handle translation for shared and user text, split into separate properties. #940

Closed NielsOerbaek closed 1 year ago

NielsOerbaek commented 1 year ago

Make the original text the default "text" property and split that into "post" and "shared". Since the scraper recommends using US locale it gives wrong texts for non-english posts. [Post,Shared] Text is original language text. Translated [Post,Shared] Text is facebooks translation. Original text is also copied to "original_text" to ensure backward compatability.

Code looks for several story_body_containers and handles them one at a time.

Should the properties be copied to the default data model?