NanmiCoder / MediaCrawler

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 百度贴吧评论回复爬虫 | 知乎问答文章|评论爬虫
Other
16.53k stars 5.28k forks source link

抖音无头浏览器采集帖子a_bogus异常 #352

Closed SilenceXSJ closed 4 weeks ago

SilenceXSJ commented 1 month ago

Traceback (most recent call last): File "C:\Program Files\JetBrains\PyCharm Community Edition 2023.3\plugins\python-ce\helpers\pydev\pydevd.py", line 1527, in _exec pydev_imports.execfile(file, globals, locals) # execute the script ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\JetBrains\PyCharm Community Edition 2023.3\plugins\python-ce\helpers\pydev_pydev_imps_pydev_execfile.py", line 18, in execfile exec(compile(contents+"\n", file, 'exec'), glob, loc) File "D:\MediaCrawler-main\MediaCrawler-main\main.py", line 49, in asyncio.get_event_loop().run_until_complete(main()) File "C:\Users\silen\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 664, in run_until_complete return future.result() ^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main\main.py", line 40, in main await crawler.start() File "D:\MediaCrawler-main\MediaCrawler-main\media_platform\douyin\core.py", line 69, in start await self.get_specified_awemes() File "D:\MediaCrawler-main\MediaCrawler-main\media_platform\douyin\core.py", line 124, in get_specified_awemes aweme_details = await asyncio.gather(*task_list) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main\media_platform\douyin\core.py", line 134, in get_aweme_detail return await self.dy_client.get_video_by_id(aweme_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main\media_platform\douyin\client.py", line 176, in get_video_by_id res = await self.get("/aweme/v1/web/aweme/detail/", params, headers) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main\media_platform\douyin\client.py", line 101, in get await self.__process_req_params(params, headers) File "D:\MediaCrawler-main\MediaCrawler-main\media_platform\douyin\client.py", line 80, in __process_req_params a_bogus = await get_a_bogus(query_string, post_data, headers["User-Agent"], self.playwright_page) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main\media_platform\douyin\help.py", line 37, in get_a_bogus return await get_a_bogus_from_playright(params, post_data, user_agent, page) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main\media_platform\douyin\help.py", line 48, in get_a_bogus_from_playright a_bogus = await page.evaluate( ^^^^^^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main.venv\Lib\site-packages\playwright\async_api_generated.py", line 8119, in evaluate await self._impl_obj.evaluate( File "D:\MediaCrawler-main\MediaCrawler-main.venv\Lib\site-packages\playwright_impl_page.py", line 416, in evaluate return await self._main_frame.evaluate(expression, arg) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main.venv\Lib\site-packages\playwright_impl_frame.py", line 278, in evaluate await self._channel.send( File "D:\MediaCrawler-main\MediaCrawler-main.venv\Lib\site-packages\playwright_impl_connection.py", line 59, in send return await self._connection.wrap_api_call( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main.venv\Lib\site-packages\playwright_impl_connection.py", line 509, in wrap_api_call return await cb() ^^^^^^^^^^ File "D:\MediaCrawler-main\MediaCrawler-main.venv\Lib\site-packages\playwright_impl_connection.py", line 97, in inner_send result = next(iter(done)).result() ^^^^^^^^^^^^^^^^^^^^^^^^^ playwright._impl._errors.Error: TypeError: Cannot read properties of undefined (reading 'init') at eval (eval at evaluate (:226:30), :1:42) at UtilityScript.evaluate (:233:19) at UtilityScript. (:1:44)

NanmiCoder commented 4 weeks ago

没有复现该问题