twintproject / twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

MIT License

15.66k stars 2.72k forks source link

[QUESTION]emojis scrapted in tweets can be displayed successfully in the terminal, but not in the csv file. What should I do? #585

Closed xiaowei-xw closed 4 years ago

xiaowei-xw commented 4 years ago

Issue Template

Please use this template!

Initial Check

If the issue is a request please specify that it is a request in the title (Example: [REQUEST] more features). If this is a question regarding 'twint' please specify that it's a question in the title (Example: [QUESTION] What is x?). Please only submit issues related to 'twint'. Thanks.

Make sure you've checked the following:

[1] Python version is 3.7;
[2] Updated Twint with pip3 install --user --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint;
[3] I have searched the issues and there are no duplicates of this issue/question/request.

Command Ran

import twint

c = twint.Config() c.Username = "Airbnb" c.Custom["tweet"]=["tweet"] c.Output="Airbnb.csv" c.Store_csv=True

twint.run.Search(c)

Description of Issue

emojis scrapted in tweets can be displayed successfully in the terminal, and they are as nomal as the user's tweet in twitter account.But they are displayed as messy code in the csv file. What should I do?

Environment Details

Using Windows, Running this in Anaconda--Jupyter Notebook

pielco11 commented 4 years ago

I'm able to see the emojis (I use gedit) so I guess it depends by the software that you use to read the CSV file

xiaowei-xw commented 4 years ago

I'm able to see the emojis (I use gedit) so I guess it depends by the software that you use to read the CSV file

Thanks a lot. Can you share your code?

pielco11 commented 4 years ago

There's no code, I just opened the CSV file with Gedit

xiaowei-xw commented 4 years ago

Can you tell me that which version of Gedit you use? and the emojies are not successfully displayed the CSV file opened with the Gedit.

pielco11 commented 4 years ago

Hmm, maybe you are missing the right font since the system can't recognize them? Here is a font that quite complete https://github.com/ryanoasis/nerd-fonts

xiaowei-xw commented 4 years ago

Hmm, maybe you are missing the right font since the system can't recognize them? Here is a font that quite complete https://github.com/ryanoasis/nerd-fonts

Thank you very much. I scan the link, but I don't understand. Can you tell me what I should do next?

pielco11 commented 4 years ago

@xiaowei-xw I'm sorry but here we discuss only about Twint related issues

I suggest you to check their instructions and, if needed, contact them

pielco11 commented 4 years ago

You have just to clone the repo, install the font(s) that you want to use, and then change the settings to let your system use the new font