search

indes / flowerss-bot

A telegram bot for rss reader. 一个支持应用内阅读的 Telegram RSS Bot。
https://flowerss-bot.now.sh/
MIT License
1.83k stars 238 forks source link

logs里面总是出现api error: Too Many Requests: retry after #41

Closed RezaFeng closed 4 years ago

RezaFeng commented 4 years ago

配置里面设置扫描间隔是30分钟，错误尝试次数是30，配合自搭建的rsshub使用

indes commented 4 years ago

能否附上完整日志截图

RezaFeng commented 4 years ago

能否附上完整日志截图

2020/04/19 03:21:23 Create telegraph page error: Post https://api.telegra.ph/createPage: x509: certificate is valid for .dns.fbinfra.net, .edgeos.fbinfra.net, .offnet.fbinfra.net, .fna.fbinfra.net, fbinfra.net, .fnedge.fbinfra.net, .ntp.fbinfra.net, .yum.fbinfra.net, .sr-offnet.fbinfra.net, .tw.fbinfra.net, .any.fbinfra.net, *.fbinfra.net, not api.telegra.ph 2020/04/19 03:21:24 Created telegraph page url: https://telegra.ph/NVIDIA发布RTX-Voice-一个AI驱动的音频降噪软件---cnBeta-04-19-5 2020/04/19 03:21:25 Created telegraph page url: https://telegra.ph/纳米技术或可灭活新冠病毒-不破坏人体其他功能---cnBeta-04-19-5 2020/04/19 03:21:26 request error: Post https://api.telegra.ph/createPage: x509: certificate is valid for redirweb2.reg.free.org, not api.telegra.ph 2020/04/19 03:21:26 Create telegraph page error: Post https://api.telegra.ph/createPage: x509: certificate is valid for redirweb2.reg.free.org, not api.telegra.ph 2020/04/19 03:21:28 Created telegraph page url: https://telegra.ph/青桔单车获超10亿美元融资-竞争格局已重构---cnBeta-04-19-5 2020/04/19 03:21:29 Created telegraph page url: https://telegra.ph/首发骁龙865三星Note-20参数曝光电池增至4000mAh---cnBeta-04-19-5 2020/04/19 03:21:39 request error: Post https://api.telegra.ph/createPage: dial tcp 67.15.100.252:443: i/o timeout 2020/04/19 03:21:39 Create telegraph page error: Post https://api.telegra.ph/createPage: dial tcp 67.15.100.252:443: i/o timeout 2020/04/19 03:21:40 Created telegraph page url: https://telegra.ph/小米开源-Redmi-Note-8-Pro-和-Note-9-Pro-系列的内核源码---cnBeta-04-19-5 2020/04/19 03:21:41 Created telegraph page url: https://telegra.ph/视频iPad-Pro妙控键盘开箱上手-和Smart-Keyboard有啥区别---cnBeta-04-19-5 2020/04/19 03:21:51 request error: Post https://api.telegra.ph/createPage: dial tcp 69.171.245.49:443: i/o timeout 2020/04/19 03:21:51 Create telegraph page error: Post https://api.telegra.ph/createPage: dial tcp 69.171.245.49:443: i/o timeout 2020/04/19 03:21:51 Source Title: Subscriber: 1 New Contents: 43 2020/04/19 03:22:11 api error: Too Many Requests: retry after 40 2020/04/19 03:22:11 api error: Too Many Requests: retry after 40 2020/04/19 03:22:12 api error: Too Many Requests: retry after 39 2020/04/19 03:22:12 api error: Too Many Requests: retry after 39 2020/04/19 03:22:13 api error: Too Many Requests: retry after 38 2020/04/19 03:22:13 api error: Too Many Requests: retry after 38 2020/04/19 03:22:14 api error: Too Many Requests: retry after 38 2020/04/19 03:22:14 api error: Too Many Requests: retry after 37 2020/04/19 03:22:15 api error: Too Many Requests: retry after 37 2020/04/19 03:22:15 api error: Too Many Requests: retry after 36 2020/04/19 03:22:15 api error: Too Many Requests: retry after 36 2020/04/19 03:22:16 api error: Too Many Requests: retry after 35 2020/04/19 03:22:16 api error: Too Many Requests: retry after 35 2020/04/19 03:22:17 api error: Too Many Requests: retry after 34 2020/04/19 03:22:17 api error: Too Many Requests: retry after 34 2020/04/19 03:22:18 api error: Too Many Requests: retry after 34 2020/04/19 03:22:18 api error: Too Many Requests: retry after 33 2020/04/19 03:22:18 api error: Too Many Requests: retry after 33 2020/04/19 03:22:19 api error: Too Many Requests: retry after 32 2020/04/19 03:22:19 api error: Too Many Requests: retry after 32 2020/04/19 03:22:20 api error: Too Many Requests: retry after 31 2020/04/19 03:22:20 api error: Too Many Requests: retry after 31 2020/04/19 03:22:21 api error: Too Many Requests: retry after 30 2020/04/19 03:22:31 request error: Post https://api.telegra.ph/createPage: dial tcp 67.228.221.221:443: i/o timeout 2020/04/19 03:22:31 Create telegraph page error: Post https://api.telegra.ph/createPage: dial tcp 67.228.221.221:443: i/o timeout

indes commented 4 years ago

Create telegraph page error: Post https://api.telegra.ph/createPage: dial tcp 67.228.221.221:443: i/o timeout

用户这边的表现是无法收到该文章推送还是该文章推送没有telegraph链接？

RezaFeng commented 4 years ago

Create telegraph page error: Post https://api.telegra.ph/createPage: dial tcp 67.228.221.221:443: i/o timeout

用户这边的表现是无法收到该文章推送还是该文章推送没有telegraph链接？

我不确定是否漏了信息的推送，但是有时候有些推送是没有telegraph链接的

indes commented 4 years ago

日志中request error: Post api.telegra.ph/createPage: dial tcp 67.15.100.252:443: i/o timeout错误比较多，建议检查一下网络情况。 api error: Too Many Requests应该是新的文章数太多，推送时大量调用telegraph api，触发到tg服务器的限制规则了，可能需要等后面的代码更新才能解决该问题。

RezaFeng commented 4 years ago

日志中request error: Post api.telegra.ph/createPage: dial tcp 67.15.100.252:443: i/o timeout错误比较多，建议检查一下网络情况。 api error: Too Many Requests应该是新的文章数太多，推送时大量调用telegraph api，触发到tg服务器的限制规则了，可能需要等后面的代码更新才能解决该问题。

创建telegraph的频率太快了可能，部分网站的抓取似乎容易被反爬，像instagram就会经常request EOF

indes commented 4 years ago

日志中request error: Post api.telegra.ph/createPage: dial tcp 67.15.100.252:443: i/o timeout错误比较多，建议检查一下网络情况。 api error: Too Many Requests应该是新的文章数太多，推送时大量调用telegraph api，触发到tg服务器的限制规则了，可能需要等后面的代码更新才能解决该问题。

创建telegraph的频率太快了可能，部分网站的抓取似乎容易被反爬，像instagram就会经常request EOF

是的，后期会尝试改进抓取策略。