twitter: analysis

[sivasankarsani737]

Not getting a massive amount of articles through the standard api.

need to explore on twitter_developer api of status-less.

[sivasankarsani737]

Deprecated attributes in Twitter:

• time_zone
• utc_offset
• Lang
• Following
• Follow_request_sent
• Profile_location
• Profile_image_url

[sivasankarsani737]

for each request we are fetching 100 articles on each-keyword.

https://api.twitter.com/1.1/search/tweets.json?count=100&oauth_nonce=280454ef43f749fa8cb6e5dfbaff1231&oauth_timestamp=1589445007&oauth_consumer_key=UoshTvh96kiFmmxBHwg&oauth_signature_method=HMAC-SHA1&q=to%253Astartup%2520OR%2520from%253Astartup&oauth_version=1.0a&oauth_token=16950741-0re8W1jQe9FYWSTROWuvb8CnoM4SS6i6n1tMK0eHO&oauth_signature=Tznhl6P4oX2GWZPcEGvY2Srl2Y4%3D'

[sivasankarsani737]

paper: project

https://api.twitter.com/1.1/search/tweets.json?count=100&oauth_nonce=280454ef43f749fa8cb6e5dfbaff1231&oauth_timestamp=1589445007&oauth_consumer_key=UoshTvh96kiFmmxBHwg&oauth_signature_method=HMAC-SHA1&q=to%253Astartup%2520OR%2520from%253Astartup&oauth_version=1.0a&oauth_token=16950741-0re8W1jQe9FYWSTROWuvb8CnoM4SS6i6n1tMK0eHO&oauth_signature=Tznhl6P4oX2GWZPcEGvY2Srl2Y4%3D'

[sivasankarsani737]

mostly getting the response-code as 599.

Response Code: 599, source: twitter_search, keyword: ap [I 200514 10:35:37 fb_tw_wp_search:345] Source twitter_search - Keyword: ap [I 200514 10:35:37 fb_tw_wp_search:456] Result: False - ap [I 200514 10:35:37 connectionpool:190] Starting new HTTP connection (1): api.cloudlibs.com [I 200514 10:35:37 connectionpool:190] Starting new HTTP connection (1): api.cloudlibs.com [I 200514 10:35:37 fb_tw_wp_search:590] Data Flushed [I 200514 10:35:37 fb_tw_wp_search:340] Response Code: 599, source: twitter_search, keyword: @paper.vc [I 200514 10:35:37 fb_tw_wp_search:345] Source twitter_search - Keyword: @paper.vc [I 200514 10:35:37 fb_tw_wp_search:456] Result: False - @paper.vc [I 200514 10:35:37 fb_tw_wp_search:461] keyword>>>>>>>>after: ['ap', '@startup', '@paper.vc', 'telugu desham party', 'paper.vc'] [I 200514 10:35:57 fb_tw_wp_search:340] Response Code: 599, source: twitter_search, keyword: @startup [I 200514 10:35:57 fb_tw_wp_search:345] Source twitter_search - Keyword: @startup [I 200514 10:35:57 fb_tw_wp_search:456] Result: False - @startup [I 200514 10:35:57 fb_tw_wp_search:461] keyword>>>>>>>>after: ['ap', '@startup', '@paper.vc', 'telugu desham party', 'paper.vc'] [I 200514 10:35:57 fb_tw_wp_search:340] Response Code: 599, source: twitter_search, keyword: telugu desham party

[sivasankarsani737]

single record o/p {'contributors': None, 'coordinates': None, 'created_at': 'Thu May 14 04:35:27 +0000 2020', 'entities': {'hashtags': [], 'symbols': [], 'urls': [{'display_url': u'twitter.com/i/web/status/1\u2026', 'expanded_url': 'https://twitter.com/i/web/status/1260790806870396930', 'indices': [117, 140], 'url': 'https://t.co/vlo5Ld5gMn'}], 'user_mentions': [{'id': 1168842955987120128, 'id_str': '1168842955987120128', 'indices': [0, 16], 'name': 'Err', 'screen_name': 'master_of_none7'}, {'id': 869459455758393344, 'id_str': '869459455758393344', 'indices': [17, 26], 'name': 'PaperVC', 'screen_name': 'paper_vc'}]}, 'favorite_count': 1, 'favorited': False, 'geo': None, 'id': 1260790806870396930, 'id_str': '1260790806870396930', 'in_reply_to_screen_name': 'master_of_none7', 'in_reply_to_status_id': 1260691790539026437, 'in_reply_to_status_id_str': '1260691790539026437', 'in_reply_to_user_id': 1168842955987120128, 'in_reply_to_user_id_str': '1168842955987120128', 'is_quote_status': False, 'lang': 'en', 'metadata': {'iso_language_code': 'en', 'result_type': 'recent'}, 'place': None, 'retweet_count': 0, 'retweeted': False, 'source': '<a href="http://twitter.com/download/android" rel="nofollow">Twitter for Android</a>', 'text': u"@master_of_none7 @paper_vc I wouldn't underestimate ANRA either. They're the only ones that have deployed a full-sc\u2026 https://t.co/vlo5Ld5gMn", 'truncated': True, 'user': {'contributors_enabled': False, 'created_at': 'Sat May 18 08:24:00 +0000 2013', 'default_profile': False, 'default_profile_image': False, 'description': 'Analyst. @Paper_vc', 'entities': {'description': {'urls': []}}, 'favourites_count': 193, 'follow_request_sent': False, 'followers_count': 94, 'following': False, 'friends_count': 580, 'geo_enabled': False, 'has_extended_profile': True, 'id': 1437778946, 'id_str': '1437778946', 'is_translation_enabled': False, 'is_translator': False, 'lang': None, 'listed_count': 1, 'location': 'Bhopal, India', 'name': 'Jayraj Bharat Patel', 'notifications': False, 'profile_background_color': '000000', 'profile_background_image_url': 'http://abs.twimg.com/images/themes/theme1/bg.png', 'profile_background_image_url_https': 'https://abs.twimg.com/images/themes/theme1/bg.png', 'profile_background_tile': False, 'profile_banner_url': 'https://pbs.twimg.com/profile_banners/1437778946/1588674543', 'profile_image_url': 'http://pbs.twimg.com/profile_images/1257005026318442504/UCbwGIv4_normal.jpg', 'profile_image_url_https': 'https://pbs.twimg.com/profile_images/1257005026318442504/UCbwGIv4_normal.jpg', 'profile_link_color': 'ABB8C2', 'profile_sidebar_border_color': '000000', 'profile_sidebar_fill_color': '000000', 'profile_text_color': '000000', 'profile_use_background_image': False, 'protected': False, 'screen_name': 'jayrajbpatel', 'statuses_count': 187, 'time_zone': None, 'translator_type': 'none', 'url': None, 'utc_offset': None, 'verified': False}}

[sivasankarsani737]

As per the standard API, should not be able to filter the location and reach.

Please note it @karthikbala @SreenivasDega