boncey / Flickr4Java

Java API For Flickr. Fork of FlickrJ
BSD 2-Clause "Simplified" License
174 stars 155 forks source link

sn-scrape not working with python 3.10.9 #691

Closed Hamxa473 closed 1 year ago

Hamxa473 commented 1 year ago

Sn-scrape error I run this code on visual studio code

import snscrape.modules.twitter as sntwitter import pandas as pd

query = "(#flood OR #California) lang:en until:2023-01-01 since:2022-08-01" tweets = [] limit = 500

for tweet in sntwitter.TwitterSearchScraper(query).get_items(): if len(tweets) == limit: break else: tweets.append([tweet.date, tweet.user.username, tweet.content])

df = pd.DataFrame(tweets, columns=['Date', 'user', 'Tweet'])

df.to_csv('flood.csv')

when run this code Error occured

error :

Exception has occurred: ScraperException 4 requests to https://api.twitter.com/2/search/adaptive.json?include_profile_interstitial_type=1&include_blocking=1&include_blocked_by=1&include_followed_by=1&include_want_retweets=1&include_mute_edge=1&include_can_dm=1&include_can_media_tag=1&skip_status=1&cards_platform=Web-12&include_cards=1&include_ext_alt_text=true&include_quote_count=true&include_reply_count=1&tweet_mode=extended&include_entities=true&include_user_entities=true&include_ext_media_color=true&include_ext_media_availability=true&send_error_codes=true&simple_quoted_tweets=true&q=%28%23flood+OR+%23California%29+lang%3Aen+until%3A2023-01-01+since%3A2022-08-01&tweet_search_mode=live&count=100&query_source=spelling_expansion_revert_click&pc=1&spelling_corrections=1&ext=mediaStats%2ChighlightedLabel failed, giving up. File "E:\new project\tweets.py", line 8, in for tweet in sntwitter.TwitterSearchScraper(query).get_items(): snscrape.base.ScraperException: 4 requests to https://api.twitter.com/2/search/adaptive.json?include_profile_interstitial_type=1&include_blocking=1&include_blocked_by=1&include_followed_by=1&include_want_retweets=1&include_mute_edge=1&include_can_dm=1&include_can_media_tag=1&skip_status=1&cards_platform=Web-12&include_cards=1&include_ext_alt_text=true&include_quote_count=true&include_reply_count=1&tweet_mode=extended&include_entities=true&include_user_entities=true&include_ext_media_color=true&include_ext_media_availability=true&send_error_codes=true&simple_quoted_tweets=true&q=%28%23flood+OR+%23California%29+lang%3Aen+until%3A2023-01-01+since%3A2022-08-01&tweet_search_mode=live&count=100&query_source=spelling_expansion_revert_click&pc=1&spelling_corrections=1&ext=mediaStats%2ChighlightedLabel failed, giving up.