foxwhite25 / megaCrawler

A auto restart scrapper
0 stars 7 forks source link

Task4 - 10web #123

Open Terminal017 opened 3 weeks ago

Terminal017 commented 3 weeks ago

概要

10个网站+1个学长修改的

检查清单

补充说明

1、一些产生错误的网站是由于它们需要登录

foxwhite25 commented 3 weeks ago

/test 1422

github-actions[bot] commented 3 weeks ago

目标为 1422 的自动测试启动了。

1422; timeout: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 83 | 65 | 78.31% | | Index | 1 | 1 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

foxwhite25 commented 1 week ago

/test

github-actions[bot] commented 1 week ago

目标为 的自动测试启动了。

1428; limit reached: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 101 | 91 | 90.10% | | Index | 1 | 1 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1429; all processed: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 0 | 0 | NaN% | | Index | 0 | 0 | NaN% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1422; limit reached: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 101 | 56 | 55.45% | | Index | 1 | 1 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1427; all processed: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 0 | 0 | NaN% | | Index | 0 | 0 | NaN% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1430; limit reached: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 101 | 28 | 27.72% | | Index | 1 | 1 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1432; all processed: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 72 | 72 | 100.00% | | Index | 9 | 9 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1423; limit reached: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 101 | 93 | 92.08% | | Index | 1 | 1 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1425; limit reached: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 101 | 101 | 100.00% | | Index | 159 | 159 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1426; limit reached: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 101 | 86 | 85.15% | | Index | 53 | 53 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1433; limit reached: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 101 | 101 | 100.00% | | Index | 2 | 2 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

1434; timeout: +--------+-------+--------+----------+ | FIELD | TOTAL | PASSED | COVERAGE | +--------+-------+--------+----------+ | News | 83 | 81 | 97.59% | | Index | 1 | 1 | 100.00% | | Expert | 0 | 0 | NaN% | | Report | 0 | 0 | NaN% | +--------+-------+--------+----------+

foxwhite25 commented 1 week ago

TODO for me:

Terminal017 commented 1 week ago

For 1427, my connection to the site was erratic, and actually my computer sometimes can pick up some news. For 1429, the site's SSL certificate expired recently (a little unlucky I think). For these two sites I will submit two new sites later. For 1422 and 1430, I will try to fix and commit a change soon.