search

twintproject / twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
MIT License
15.75k stars 2.72k forks source link

[KNOWN ISSUE] ELK does not play well with tweet.reply_to #502

Open pielco11 opened 5 years ago

pielco11 commented 5 years ago

The mapping that I use follows the documentation. We have a list of nested JSON objects

It's an issue in the ELK stack, not Twint. Workarounds/solutions are welcome.

What we can do

What we can't do

It also seems that some ranks (about reply_to) are quite crazy (an user reported results like 150%, which means finding more that having)

antoinefranz commented 5 years ago

A solution would be welcome! We're also working on it. What about working directly with two lists (reply_to ids and usernames) instead of nested objects?

pielco11 commented 5 years ago

Me and another user were thinking about a solution (as discussed on osint.team's dedicated channel for twint) and came to the conclusion that using two separated lists would be the best suitable solution (as of now).

I kindly ask you to wait a couple of days, I'm quite busy.

Thank you!

-------- Messaggio originale -------- On 19 Ago 2019, 16:49, antoinefranz ha scritto:

A solution would be welcome! We're also working on it. What about working directly with two lists (reply_to ids and usernames) instead of nested objects?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.