search

mikeizbicki / cmc-csci143

big data course materials
40 stars 76 forks source link

batch returning error #499

Closed giffiecode closed 5 months ago

giffiecode commented 6 months ago 
d Dec 17 00:47:35 +0000 2014', 'updated_at998': 'Sat Jan 09 00:00:21 +0000 2021', 'favourites_count999': 179020, 'name999': 'yėlløw \U0001fa90', 'location999': '.ᨘ۫.ꪶ\xa0☪  𝑦𝑒𝑙𝑙𝑦', 'screen_name999': 'itsyllw', 'listed_count999': 30, 'withheld_in_countries999': None, 'friends_count999': 881, 'verified999': False, 'description999': 'vaza only stan | fan account', 'statuses_count999': 85257, 'protected999': False, 'id_users999': 2253036347, 'urls999': 'https://y-llw.carrd.co/', 'created_at999': 'Mon Dec 30 22:24:25 +0000 2013', 'updated_at999': 'Sat Jan 09 00:00:21 +0000 2021'}]
(Background on this error at: https://sqlalche.me/e/14/f405)

I got this error for batch when running ./load_tweets_parallel.sh. why is it spitting out the json data?

vitorvavolizza commented 6 months ago

run docker volume ls, then get all volume names and run docker volume rm volume_name1 volume_name2 volume_name3.... for all volumes, then run docker-compose down, docker-compose up -d, and ./load_tweets_parallel.sh. that will probably clean everything.