y-ken / fluent-plugin-twitter

Fluentd Input/Output plugin to process tweets with Twitter Streaming API.
https://rubygems.org/gems/fluent-plugin-twitter
Other
53 stars 27 forks source link

Correct false positives in language determination. #45

Open shibacow opened 5 years ago

shibacow commented 5 years ago

HI twitter.user.lang has become null due to a sudden specification change of twitter streaming api.

https://developer.twitter.com/en/docs/tweets/sample-realtime/api-reference

so,now.input parameter is not work.

 lang                ja,en                    # Optional

in_twitter.rb return allways true,even a language different from the specified language.

 return false if (!@lang.nil? && @lang != '') && !@lang.include?(tweet.user.lang)

so.therefore, I changed to use twitter.lang instead of twitter.user.lang to determine the language.