search

godkingjay / selenium-twitter-scraper

This is a Twitter Scraper which uses Selenium for scraping tweets. It is capable of scraping tweets from home, user profile, hashtag, query or search, and advanced searches.
Apache License 2.0
176 stars 46 forks source link

Twitter @user mentions and emojis/emoticons missing #1

Closed badjoerichards closed 1 year ago

badjoerichards commented 1 year ago

Nice work! But it seems like user twitter handle mentions i.e. @elon @jay are not recorded in the .csv outputs.

Also emojis / emoticons are removed as well.

Are we able to have them in the "content" or in 2 new columns like "mentions" and "emojis"?

godkingjay commented 1 year ago

Hello @badjoerichards , thank you for raising this issue.

It is actually possible to save the mentions and emojis in the .csv output. However we need to convert the emoji into another form like unicode or byte sequence since it's not possible to save the emoji as it is.

feat: scrape mentions and emojis

badjoerichards commented 1 year ago

Thank you, perfect!