search

DocNow / hydrator

Turn Tweet IDs into Twitter JSON & CSV from your desktop!
MIT License
428 stars 62 forks source link

Contents of tweets are not complete #105

Closed mcolemann closed 3 years ago

mcolemann commented 3 years ago

Hi!

I downloaded the .csv file but the text is not complete, somehow the application cut the text. Do you know where is the problem?

Thanks a lot!

igorbrigadir commented 3 years ago

Are you perhaps looking at retweets? In that case, the original text is in retweeted_status and is truncated set to true?

mcolemann commented 3 years ago

Thanks a lot for your answer. Yes, I have problems with the retweets... I don't have a variable called retweeted_status... Is it normal? What should I do?

edsu commented 3 years ago

Yes, the CSV generation should be updated to use .retweeted_status.full_text when available. I can update that.

edsu commented 3 years ago

Please give v0.3.0 a try. It should have the full text from the retweet. Thanks for noticing the problem and taking the time to enter an issue here.

mcolemann commented 3 years ago

Hi! Thanks for your answer! Should I rerun everything? Or can I somehow use the .jsonl files that I have so save time?

edsu commented 3 years ago

@mcolemann I think you should be able to use the existing .jsonl files if your Hydrator app can still see them.

mcolemann commented 3 years ago

Thanks for the very quick answers! So, should I install the new version of the app and hope that it can read the "old" .jsonl files? Are the .jsonl files complete or also there the content is cut?