search

puppylpg / oddish

Crawl csgo skin info from `buff.163.com` and steam, then find the most suitable one to buy from the former and to sell to the latter.
https://puppylpg.github.io/2019/12/07/python-crawler-buff-optimaze/
GNU General Public License v3.0
323 stars 81 forks source link

访问市场超时 #87

Open YBFACC opened 3 years ago

YBFACC commented 3 years ago

问题描述

访问市场超时 我使用代理无法访问市场，代理是正常的。 使用curl测试： 使用socks5代理 curl -x socks5://127.0.0.1:1086 https://steamcommunity.com/market/ 正常访问

复现步骤

报错信息

Timeout for https://steamcommunity.com/market/

相关截屏（最好贴一下）

软件信息

请完善以下信息：

KnightFizz commented 2 years ago

解决了吗

puppylpg commented 2 years ago

代理的端口配置里不是1086，改一下吧

如果gui没法改，可以把代码回退到上一个没有gui的版本

FengZhiheng commented 2 years ago

遇到了相同问题； Win10操作系统，GUI版oddish，修改了端口号7890，采用了clash全局翻墙，仍然报错：

2022-02-14 23:58:46,239 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [ERROR]  Timeout for https://steamcommunity.com/market/ beyond the maximum(3) retry times. SKIP!
ccinv commented 2 years ago

遇到了相同问题； Win10操作系统，GUI版oddish，修改了端口号7890，采用了clash全局翻墙，仍然报错：

2022-02-14 23:58:46,239 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [ERROR]  Timeout for https://steamcommunity.com/market/ beyond the maximum(3) retry times. SKIP!

是否提示缺少 cacert.pem 文件？如果是的话，可以下载 http://curl.haxx.se/ca/cacert.pem ，在程序目录下新建 certifi 文件夹并且放入下载的文件，看一下问题是否解决。

FengZhiheng commented 2 years ago

遇到了相同问题； Win10操作系统，GUI版oddish，修改了端口号7890，采用了clash全局翻墙，仍然报错：

2022-02-14 23:58:46,239 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [ERROR]  Timeout for https://steamcommunity.com/market/ beyond the maximum(3) retry times. SKIP!

问题解决了，我做了以下的操作： 1、修改代理地址：proxy = socks5h://127.0.0.1:7890，必须得加h； 2、修改item_crawler.py第91行，改为“connector = ProxyConnector.from_url('socks5://127.0.0.1:7890', limit=5)”。不然会报错； 3、修改suggestion.py第38行，把“history_sold”修改成“sell_num”，因为history_sold变量值全是0；

puppylpg commented 2 years ago

遇到了相同问题； Win10操作系统，GUI版oddish，修改了端口号7890，采用了clash全局翻墙，仍然报错：

2022-02-14 23:58:46,239 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [ERROR]  Timeout for https://steamcommunity.com/market/ beyond the maximum(3) retry times. SKIP!

问题解决了，我做了以下的操作： 1、修改代理地址：proxy = socks5h://127.0.0.1:7890，必须得加h； 2、修改item_crawler.py第91行，改为“connector = ProxyConnector.from_url('socks5://127.0.0.1:7890', limit=5)”。不然会报错； 3、修改suggestion.py第38行，把“history_sold”修改成“sell_num”，因为history_sold变量值全是0；

mark一下，回去看看

ccinv commented 2 years ago

遇到了相同问题； Win10操作系统，GUI版oddish，修改了端口号7890，采用了clash全局翻墙，仍然报错：

2022-02-14 23:58:46,239 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [WARNI]  Timeout for https://steamcommunity.com/market/. Try again.
2022-02-14 23:58:51,275 [ERROR]  Timeout for https://steamcommunity.com/market/ beyond the maximum(3) retry times. SKIP!

问题解决了，我做了以下的操作： 1、修改代理地址：proxy = socks5h://127.0.0.1:7890，必须得加h； 2、修改item_crawler.py第91行，改为“connector = ProxyConnector.from_url('socks5://127.0.0.1:7890', limit=5)”。不然会报错； 3、修改suggestion.py第38行，把“history_sold”修改成“sell_num”，因为history_sold变量值全是0；

感觉historysold那个可能是steam cookie没获取完整导致的，我这用完整的cookie爬了一遍historysold不是空的