loganwilliams
commented
2 years ago Closed loganwilliams closed 2 years ago
loganwilliams
commented
2 years ago loganwilliams
commented
2 years ago 2022-04-02 13:43:07.625 | DEBUG | cisticola.utils:make_request:41 - Request for url: https://rumble.com/user/ChloeFra?page=1 succeeded on attempt: 0/5
2022-04-02 13:43:07.643 | ERROR | cisticola.scraper.base:scrape_channels:398 - An error has been caught in function 'scrape_channels', process 'MainProcess' (63504), thread 'MainThread' (139778754606912):
Traceback (most recent call last):
File "/home/loganw/cisticola/app.py", line 136, in <module>
scrape_channels(args)
│ └ Namespace(command='scrape-channels', gsheet=None, media=False)
└ <function scrape_channels at 0x7f20b9d52a60>
File "/home/loganw/cisticola/app.py", line 100, in scrape_channels
controller.scrape_all_channels(archive_media = args.media)
│ │ │ └ False
│ │ └ Namespace(command='scrape-channels', gsheet=None, media=False)
│ └ <function ScraperController.scrape_all_channels at 0x7f20bb9fd280>
└ <cisticola.scraper.base.ScraperController object at 0x7f20b9d1bcd0>
File "/home/loganw/cisticola/cisticola/scraper/base.py", line 332, in scrape_all_channels
return self.scrape_channels(channels, archive_media=archive_media)
│ │ │ └ False
│ │ └ [Channel(name='Qanonfighters', platform_id='1412770923', category='qanon', platform='Telegram', url='https://ttttt.me/qanonfi...
│ └ <function ScraperController.scrape_channels at 0x7f20bb9fd3a0>
└ <cisticola.scraper.base.ScraperController object at 0x7f20b9d1bcd0>
> File "/home/loganw/cisticola/cisticola/scraper/base.py", line 398, in scrape_channels
for post in posts:
│ └ <generator object RumbleScraper.get_posts at 0x7f20b7524040>
└ ScraperResult(scraper='TwitterScraper 0.0.1', platform='Twitter', channel=178, platform_id='1497407385425612804', date=dateti...
File "/home/loganw/cisticola/cisticola/scraper/rumble.py", line 23, in get_posts
for post in scraper:
└ <generator object get_channel_videos at 0x7f20b7983e40>
File "/home/loganw/cisticola/cisticola/scraper/rumble.py", line 127, in get_channel_videos
yield process_video(video)
│ └ <li class="video-listing-entry"><article class="video-item"><h3 class="video-item--title">lNFO en QUESTlONS #94 avec Raphaël ...
└ <function process_video at 0x7f20ba8a9790>
File "/home/loganw/cisticola/cisticola/scraper/rumble.py", line 101, in process_video
'views' : video.find('span', {'class' : 'video-item--views'})['data-value'],
│ └ <function Tag.find at 0x7f20bb3719d0>
└ <li class="video-listing-entry"><article class="video-item"><h3 class="video-item--title">lNFO en QUESTlONS #94 avec Raphaël ...
TypeError: 'NoneType' object is not subscriptable
2022-04-02 13:43:07.665 | INFO | cisticola.scraper.base:scrape_channels:407 - RumbleScraper 0.0.1 found 0 new posts from Channel(name='ChloeFra', platform_id=None, category='conspiracy', platform='Rumble', url='https://rumble.com/user/ChloeFra', screenname=None, country='FR', influencer='Chloé Frammery', public=True, chat=False, notes=None, source='researcher')
trislee
commented
2 years ago