Evil0ctal / Douyin_TikTok_Download_API

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具,支持API调用,在线批量解析及下载。
https://douyin.wtf
Apache License 2.0
7.72k stars 1.23k forks source link

[BUG] 请求失败 #376

Closed markvlenvision closed 2 months ago

markvlenvision commented 2 months ago

环境 系统:ubuntu 20.04.6 LTS 网络:软路由+国内外分流

日志: 2024-04-30 12:19:58,159 - TikHub_Crawlers - ERROR - msToken API错误:timed out 2024-04-30 12:19:58,166 - TikHub_Crawlers - INFO - 生成虚假的msToken 2024-04-30 12:21:41,892 - TikHub_Crawlers - WARNING - 第 1 次响应内容为空, 状态码: 200, URL:https://www.douyin.com/aweme/v1/web/aweme/detail/?device_platform=webapp&aid=6383&channel=channel_pc_web&pc_client_type=1&version_code=190500&version_name=19.5.0&cookie_enabled=true&screen_width=1920&screen_height=1080&browser_language=zh-CN&browser_platform=Win32&browser_name=Firefox&browser_version=124.0&browser_online=true&engine_name=Gecko&engine_version=122.0.0.0&os_name=Windows&os_version=10&cpu_core_num=12&device_memory=8&platform=PC&msToken=QkWZJEJquKRXPB_KyI3PyjJXwckWlF-uoRrRnWvasVGbz96SsWvAr6NdGURXyJbprCm-NWOHgXUP2KdBwBWjO6fz6eOrHCAvYDnaPEGszikm-Jz3pSqNoUe8MErVEQ==&aweme_id=7359917210246106406&X-Bogus=DFSzswVYwfXANGVRtRfo/F9WX7nr 2024-04-30 12:21:52,082 - TikHub_Crawlers - WARNING - 第 2 次响应内容为空, 状态码: 200, URL:https://www.douyin.com/aweme/v1/web/aweme/detail/?device_platform=webapp&aid=6383&channel=channel_pc_web&pc_client_type=1&version_code=190500&version_name=19.5.0&cookie_enabled=true&screen_width=1920&screen_height=1080&browser_language=zh-CN&browser_platform=Win32&browser_name=Firefox&browser_version=124.0&browser_online=true&engine_name=Gecko&engine_version=122.0.0.0&os_name=Windows&os_version=10&cpu_core_num=12&device_memory=8&platform=PC&msToken=QkWZJEJquKRXPB_KyI3PyjJXwckWlF-uoRrRnWvasVGbz96SsWvAr6NdGURXyJbprCm-NWOHgXUP2KdBwBWjO6fz6eOrHCAvYDnaPEGszikm-Jz3pSqNoUe8MErVEQ==&aweme_id=7359917210246106406&X-Bogus=DFSzswVYwfXANGVRtRfo/F9WX7nr 2024-04-30 12:22:02,196 - TikHub_Crawlers - WARNING - 第 3 次响应内容为空, 状态码: 200, URL:https://www.douyin.com/aweme/v1/web/aweme/detail/?device_platform=webapp&aid=6383&channel=channel_pc_web&pc_client_type=1&version_code=190500&version_name=19.5.0&cookie_enabled=true&screen_width=1920&screen_height=1080&browser_language=zh-CN&browser_platform=Win32&browser_name=Firefox&browser_version=124.0&browser_online=true&engine_name=Gecko&engine_version=122.0.0.0&os_name=Windows&os_version=10&cpu_core_num=12&device_memory=8&platform=PC&msToken=QkWZJEJquKRXPB_KyI3PyjJXwckWlF-uoRrRnWvasVGbz96SsWvAr6NdGURXyJbprCm-NWOHgXUP2KdBwBWjO6fz6eOrHCAvYDnaPEGszikm-Jz3pSqNoUe8MErVEQ==&aweme_id=7359917210246106406&X-Bogus=DFSzswVYwfXANGVRtRfo/F9WX7nr 2024-04-30 12:22:02,200 - TikHub_Crawlers - ERROR - 无效响应类型。响应类型: <class 'NoneType'>

Evil0ctal commented 2 months ago

请问你更换自己的cookie了吗?

markvlenvision commented 2 months ago

请问你更换自己的cookie了吗?

换了,以下代码获取的cookie document.cookie .split(";") .filter((e) => [ "ttwid", "IsDouyinActive", "home_can_add_dy_2_desktop", "dy_swidth", "dy_sheight", "stream_recommend_feed_params", "strategyABtestKey", "msToken", "passport_csrf_token", "passport_csrf_token_default", "bd_ticket_guard_client_web_domain", "GlobalGuideTimes", "odin_tt", "n_mh", "_bd_ticket_crypt_doamin", "_bd_ticket_crypt_cookie", "LOGIN_STATUS", "security_server_data_status", "store-region", "store-region-src", "d_ticket", "my_rd", "stream_player_status_params", "live_version", "live_use_vvc", "volume_info", "FORCE_LOGIN", "xgplayer_user_id", "s_v_web_id", "download_guide", "SEARCH_RESULT_LIST_TYPE", "bd_ticket_guard_client_data", "tt_scid", "msToken", "ac_nonce", "__ac_signature" ].includes(e.split("=")[0].trim()) ) .join(";");

Evil0ctal commented 2 months ago

直接使用当前仓库中的cookie即可

markvlenvision commented 2 months ago

直接使用当前仓库中的cookie即可

替换了重启项目,也不行,无论用自己的cookie,还是用仓库的日志都如下

启动时日志:

2024-05-01 03:56:33,258 - TikHub_Crawlers - ERROR - msToken API错误:timed out
2024-05-01 03:56:33,264 - TikHub_Crawlers - INFO - 生成虚假的msToken

第一次请求日志:

2024-05-01 03:57:13,333 - TikHub_Crawlers - ERROR - msToken API错误:timed out
2024-05-01 03:57:13,339 - TikHub_Crawlers - INFO - 生成虚假的msToken
2024-05-01 04:01:44,124 - TikHub_Crawlers - WARNING - 第 1 次响应内容为空, 状态码: 200, URL:https://www.douyin.com/aweme/v1/web/aweme/detail/?device_platform=webapp&aid=6383&channel=channel_pc_web&pc_client_type=1&version_code=190500&version_name=19.5.0&cookie_enabled=true&screen_width=1920&screen_height=1080&browser_language=zh-CN&browser_platform=Win32&browser_name=Firefox&browser_version=124.0&browser_online=true&engine_name=Gecko&engine_version=122.0.0.0&os_name=Windows&os_version=10&cpu_core_num=12&device_memory=8&platform=PC&msToken=BWhlQzVBBCpu4Ro4HJwLb5IwDP0XlSSLptboyt0UICIWuqCu2Ww5rdNdImZ-H0xh1lsyYaIwFGuzxhGeZpgJgR9ESxE6T5offZtVYzJXjbJgdO3KzqjAisgO1TVlhw==&aweme_id=6914948781100338440&X-Bogus=DFSzswVYjCUANGVRtRXcJe9WX7Ja
2024-05-01 04:01:54,247 - TikHub_Crawlers - WARNING - 第 2 次响应内容为空, 状态码: 200, URL:https://www.douyin.com/aweme/v1/web/aweme/detail/?device_platform=webapp&aid=6383&channel=channel_pc_web&pc_client_type=1&version_code=190500&version_name=19.5.0&cookie_enabled=true&screen_width=1920&screen_height=1080&browser_language=zh-CN&browser_platform=Win32&browser_name=Firefox&browser_version=124.0&browser_online=true&engine_name=Gecko&engine_version=122.0.0.0&os_name=Windows&os_version=10&cpu_core_num=12&device_memory=8&platform=PC&msToken=BWhlQzVBBCpu4Ro4HJwLb5IwDP0XlSSLptboyt0UICIWuqCu2Ww5rdNdImZ-H0xh1lsyYaIwFGuzxhGeZpgJgR9ESxE6T5offZtVYzJXjbJgdO3KzqjAisgO1TVlhw==&aweme_id=6914948781100338440&X-Bogus=DFSzswVYjCUANGVRtRXcJe9WX7Ja
2024-05-01 04:02:04,342 - TikHub_Crawlers - WARNING - 第 3 次响应内容为空, 状态码: 200, URL:https://www.douyin.com/aweme/v1/web/aweme/detail/?device_platform=webapp&aid=6383&channel=channel_pc_web&pc_client_type=1&version_code=190500&version_name=19.5.0&cookie_enabled=true&screen_width=1920&screen_height=1080&browser_language=zh-CN&browser_platform=Win32&browser_name=Firefox&browser_version=124.0&browser_online=true&engine_name=Gecko&engine_version=122.0.0.0&os_name=Windows&os_version=10&cpu_core_num=12&device_memory=8&platform=PC&msToken=BWhlQzVBBCpu4Ro4HJwLb5IwDP0XlSSLptboyt0UICIWuqCu2Ww5rdNdImZ-H0xh1lsyYaIwFGuzxhGeZpgJgR9ESxE6T5offZtVYzJXjbJgdO3KzqjAisgO1TVlhw==&aweme_id=6914948781100338440&X-Bogus=DFSzswVYjCUANGVRtRXcJe9WX7Ja
2024-05-01 04:02:04,346 - TikHub_Crawlers - ERROR - 无效响应类型。响应类型: <class 'NoneType'>

另外我本地获取的cookie缺少:s_v_web_id、ttwid两项参数,这个会有影响吗,我清空cookie,重新登陆也没有获取到, 你的这几项:__ac_nonce、__ac_signature、s_v_web_id、ttwid、IsDouyinActive、home_can_add_dy_2_desktop、dy_swidth、dy_sheight、stream_recommend_feed_params参数是缺一不可吗?

Evil0ctal commented 2 months ago

看一下视频教程:

【【开源项目教程】教你一分钟内部署属于你自己的抖音和TikTok数据接口,可以下载视频,做数据分析等。-哔哩哔哩】 https://b23.tv/MTGT71Z

markvlenvision commented 2 months ago

看一下视频教程:

【【开源项目教程】教你一分钟内部署属于你自己的抖音和TikTok数据接口,可以下载视频,做数据分析等。-哔哩哔哩】 https://b23.tv/MTGT71Z

按照你的方法,已经获取到数据了,是cookie的问题,感谢。

Evil0ctal commented 2 months ago

不客气