renhai-lab / sgcc_electricity

本应用可以帮助你将国网的电费、用电量数据接入homeassistant,并且储存到数据库。
159 stars 45 forks source link

!!!最新1.3.3版本因网页结构改变已无法获取数据 #34

Open cypher993 opened 11 months ago

cypher993 commented 11 months ago

10月19号前正常,今天运行报错,日志如下

2023/10/19 09:11:23 | stderr |   2023/10/19 09:11:23 | stderr | #20 0x7f709714406f clone 2023/10/19 09:11:23 | stderr | #19 0x7f7097eedfa3 start_thread 2023/10/19 09:11:23 | stderr | #18 0x55d92cdeaa1f  2023/10/19 09:11:23 | stderr | #17 0x55d92cdd2778  2023/10/19 09:11:23 | stderr | #16 0x55d92cdd25d2  2023/10/19 09:11:23 | stderr | #15 0x55d92cda0e00  2023/10/19 09:11:23 | stderr | #14 0x55d92cdbb5b9  2023/10/19 09:11:23 | stderr | #13 0x55d92cdbf13a  2023/10/19 09:11:23 | stderr | #12 0x55d92cdba9e4  2023/10/19 09:11:23 | stderr | #11 0x55d92cdbace7  2023/10/19 09:11:23 | stderr | #10 0x55d92cdab542  2023/10/19 09:11:23 | stderr | #9 0x55d92caf24d2  2023/10/19 09:11:23 | stderr | #8 0x55d92caf0ce4  2023/10/19 09:11:23 | stderr | #7 0x55d92cb1ec93  2023/10/19 09:11:23 | stderr | #6 0x55d92cb2f9e1  2023/10/19 09:11:23 | stderr | #5 0x55d92cb1eded  2023/10/19 09:11:23 | stderr | #4 0x55d92cb318fb  2023/10/19 09:11:23 | stderr | #3 0x55d92cafb81e  2023/10/19 09:11:23 | stderr | #2 0x55d92cac7016  2023/10/19 09:11:23 | stderr | #1 0x55d92cd7f3b3  2023/10/19 09:11:23 | stderr | #0 0x55d92cddf7f9  2023/10/19 09:11:23 | stderr | Stacktrace: 2023/10/19 09:11:23 | stderr | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:11:23 | stderr | selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:11:23 | stderr | raise exception_class(message, screen, stacktrace) 2023/10/19 09:11:23 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/errorhandler.py", line 243, in check_response 2023/10/19 09:11:23 | stderr | self.error_handler.check_response(response) 2023/10/19 09:11:23 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 429, in execute 2023/10/19 09:11:23 | stderr | return self.execute(Command.FIND_ELEMENT, { 2023/10/19 09:11:23 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 856, in find_element 2023/10/19 09:11:23 | stderr | captcha_element = driver.find_element(By.CLASS_NAME, "code-mask") 2023/10/19 09:11:23 | stderr | File "/app/data_fetcher.py", line 152, in _login 2023/10/19 09:11:23 | stderr | self._login(driver) 2023/10/19 09:11:23 | stderr | File "/app/data_fetcher.py", line 107, in _fetch 2023/10/19 09:11:23 | stderr | return self._fetch() 2023/10/19 09:11:23 | stderr | File "/app/data_fetcher.py", line 90, in fetch 2023/10/19 09:11:23 | stderr | raise e 2023/10/19 09:11:23 | stderr | File "/app/data_fetcher.py", line 93, in fetch 2023/10/19 09:11:23 | stderr | user_id_list, balance_list, last_daily_date_list, last_daily_usage_list, yearly_charge_list, yearly_usage_list = data_fetcher.fetch() 2023/10/19 09:11:23 | stderr | File "main.py", line 57, in run_task 2023/10/19 09:11:23 | stdout |   2023/10/19 09:11:23 | stdout | #20 0x7f709714406f clone 2023/10/19 09:11:23 | stdout | #19 0x7f7097eedfa3 start_thread 2023/10/19 09:11:23 | stdout | #18 0x55d92cdeaa1f  2023/10/19 09:11:23 | stdout | #17 0x55d92cdd2778  2023/10/19 09:11:23 | stdout | #16 0x55d92cdd25d2  2023/10/19 09:11:23 | stdout | #15 0x55d92cda0e00  2023/10/19 09:11:23 | stdout | #14 0x55d92cdbb5b9  2023/10/19 09:11:23 | stdout | #13 0x55d92cdbf13a  2023/10/19 09:11:23 | stdout | #12 0x55d92cdba9e4  2023/10/19 09:11:23 | stdout | #11 0x55d92cdbace7  2023/10/19 09:11:23 | stdout | #10 0x55d92cdab542  2023/10/19 09:11:23 | stdout | #9 0x55d92caf24d2  2023/10/19 09:11:23 | stdout | #8 0x55d92caf0ce4  2023/10/19 09:11:23 | stdout | #7 0x55d92cb1ec93  2023/10/19 09:11:23 | stdout | #6 0x55d92cb2f9e1  2023/10/19 09:11:23 | stdout | #5 0x55d92cb1eded  2023/10/19 09:11:23 | stdout | #4 0x55d92cb318fb  2023/10/19 09:11:23 | stdout | #3 0x55d92cafb81e  2023/10/19 09:11:23 | stdout | #2 0x55d92cac7016  2023/10/19 09:11:23 | stdout | #1 0x55d92cd7f3b3  2023/10/19 09:11:23 | stdout | #0 0x55d92cddf7f9  2023/10/19 09:11:23 | stdout | Stacktrace: 2023/10/19 09:11:23 | stdout | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:11:23 | stdout | 2023-10-19 09:11:23  [ERROR   ] ---- state-refresh task failed, reason is Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:11:23 | stderr | Traceback (most recent call last): 2023/10/19 09:10:16 | stdout | 2023-10-19 09:10:16  [INFO    ] ---- Webdriver initialized. 2023/10/19 09:09:36 | stdout | . 1 retry times left. 2023/10/19 09:09:36 | stdout | #20 0x7fdef251206f clone 2023/10/19 09:09:36 | stdout | #19 0x7fdef32bbfa3 start_thread 2023/10/19 09:09:36 | stdout | #18 0x55edbfccba1f  2023/10/19 09:09:36 | stdout | #17 0x55edbfcb3778  2023/10/19 09:09:36 | stdout | #16 0x55edbfcb35d2  2023/10/19 09:09:36 | stdout | #15 0x55edbfc81e00  2023/10/19 09:09:36 | stdout | #14 0x55edbfc9c5b9  2023/10/19 09:09:36 | stdout | #13 0x55edbfca013a  2023/10/19 09:09:36 | stdout | #12 0x55edbfc9b9e4  2023/10/19 09:09:36 | stdout | #11 0x55edbfc9bce7  2023/10/19 09:09:36 | stdout | #10 0x55edbfc8c542  2023/10/19 09:09:36 | stdout | #9 0x55edbf9d34d2  2023/10/19 09:09:36 | stdout | #8 0x55edbf9d1ce4  2023/10/19 09:09:36 | stdout | #7 0x55edbf9ffc93  2023/10/19 09:09:36 | stdout | #6 0x55edbfa109e1  2023/10/19 09:09:36 | stdout | #5 0x55edbf9ffded  2023/10/19 09:09:36 | stdout | #4 0x55edbfa128fb  2023/10/19 09:09:36 | stdout | #3 0x55edbf9dc81e  2023/10/19 09:09:36 | stdout | #2 0x55edbf9a8016  2023/10/19 09:09:36 | stdout | #1 0x55edbfc603b3  2023/10/19 09:09:36 | stdout | #0 0x55edbfcc07f9  2023/10/19 09:09:36 | stdout | Stacktrace: 2023/10/19 09:09:36 | stdout | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:09:36 | stdout | 2023-10-19 09:09:36  [ERROR   ] ---- Webdriver quit abnormly, reason: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:09:36 | stderr |   2023/10/19 09:09:36 | stderr | #20 0x7fdef251206f clone 2023/10/19 09:09:36 | stderr | #19 0x7fdef32bbfa3 start_thread 2023/10/19 09:09:36 | stderr | #18 0x55edbfccba1f  2023/10/19 09:09:36 | stderr | #17 0x55edbfcb3778  2023/10/19 09:09:36 | stderr | #16 0x55edbfcb35d2  2023/10/19 09:09:36 | stderr | #15 0x55edbfc81e00  2023/10/19 09:09:36 | stderr | #14 0x55edbfc9c5b9  2023/10/19 09:09:36 | stderr | #13 0x55edbfca013a  2023/10/19 09:09:36 | stderr | #12 0x55edbfc9b9e4  2023/10/19 09:09:36 | stderr | #11 0x55edbfc9bce7  2023/10/19 09:09:36 | stderr | #10 0x55edbfc8c542  2023/10/19 09:09:36 | stderr | #9 0x55edbf9d34d2  2023/10/19 09:09:36 | stderr | #8 0x55edbf9d1ce4  2023/10/19 09:09:36 | stderr | #7 0x55edbf9ffc93  2023/10/19 09:09:36 | stderr | #6 0x55edbfa109e1  2023/10/19 09:09:36 | stderr | #5 0x55edbf9ffded  2023/10/19 09:09:36 | stderr | #4 0x55edbfa128fb  2023/10/19 09:09:36 | stderr | #3 0x55edbf9dc81e  2023/10/19 09:09:36 | stderr | #2 0x55edbf9a8016  2023/10/19 09:09:36 | stderr | #1 0x55edbfc603b3  2023/10/19 09:09:36 | stderr | #0 0x55edbfcc07f9  2023/10/19 09:09:36 | stderr | Stacktrace: 2023/10/19 09:09:36 | stderr | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:09:36 | stderr | selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:09:36 | stderr | raise exception_class(message, screen, stacktrace) 2023/10/19 09:09:36 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/errorhandler.py", line 243, in check_response 2023/10/19 09:09:36 | stderr | self.error_handler.check_response(response) 2023/10/19 09:09:36 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 429, in execute 2023/10/19 09:09:36 | stderr | return self.execute(Command.FIND_ELEMENT, { 2023/10/19 09:09:36 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 856, in find_element 2023/10/19 09:09:36 | stderr | captcha_element = driver.find_element(By.CLASS_NAME, "code-mask") 2023/10/19 09:09:36 | stderr | File "/app/data_fetcher.py", line 152, in _login 2023/10/19 09:09:36 | stderr | self._login(driver) 2023/10/19 09:09:36 | stderr | File "/app/data_fetcher.py", line 107, in _fetch 2023/10/19 09:09:36 | stderr | return self._fetch() 2023/10/19 09:09:36 | stderr | File "/app/data_fetcher.py", line 90, in fetch 2023/10/19 09:09:36 | stderr | Traceback (most recent call last): 2023/10/19 09:08:29 | stdout | 2023-10-19 09:08:29  [INFO    ] ---- Webdriver initialized. 2023/10/19 09:07:59 | stderr |   2023/10/19 09:07:59 | stderr | #20 0x7f46cab0506f clone 2023/10/19 09:07:59 | stderr | #19 0x7f46cb8aefa3 start_thread 2023/10/19 09:07:59 | stderr | #18 0x55e255472a1f  2023/10/19 09:07:59 | stderr | #17 0x55e25545a778  2023/10/19 09:07:59 | stderr | #16 0x55e25545a5d2  2023/10/19 09:07:59 | stderr | #15 0x55e255428e00  2023/10/19 09:07:59 | stderr | #14 0x55e2554435b9  2023/10/19 09:07:59 | stderr | #13 0x55e25544713a  2023/10/19 09:07:59 | stderr | #12 0x55e2554429e4  2023/10/19 09:07:59 | stderr | #11 0x55e255442ce7  2023/10/19 09:07:59 | stderr | #10 0x55e255433542  2023/10/19 09:07:59 | stderr | #9 0x55e25517a4d2  2023/10/19 09:07:59 | stderr | #8 0x55e255178ce4  2023/10/19 09:07:59 | stderr | #7 0x55e2551a6c93  2023/10/19 09:07:59 | stderr | #6 0x55e2551b79e1  2023/10/19 09:07:59 | stderr | #5 0x55e2551a6ded  2023/10/19 09:07:59 | stderr | #4 0x55e2551b98fb  2023/10/19 09:07:59 | stdout | . 2 retry times left. 2023/10/19 09:07:59 | stdout | #20 0x7f46cab0506f clone 2023/10/19 09:07:59 | stdout | #19 0x7f46cb8aefa3 start_thread 2023/10/19 09:07:59 | stdout | #18 0x55e255472a1f  2023/10/19 09:07:59 | stdout | #17 0x55e25545a778  2023/10/19 09:07:59 | stdout | #16 0x55e25545a5d2  2023/10/19 09:07:59 | stdout | #15 0x55e255428e00  2023/10/19 09:07:59 | stdout | #14 0x55e2554435b9  2023/10/19 09:07:59 | stdout | #13 0x55e25544713a  2023/10/19 09:07:59 | stdout | #12 0x55e2554429e4  2023/10/19 09:07:59 | stdout | #11 0x55e255442ce7  2023/10/19 09:07:59 | stdout | #10 0x55e255433542  2023/10/19 09:07:59 | stdout | #9 0x55e25517a4d2  2023/10/19 09:07:59 | stdout | #8 0x55e255178ce4  2023/10/19 09:07:59 | stdout | #7 0x55e2551a6c93  2023/10/19 09:07:59 | stdout | #6 0x55e2551b79e1  2023/10/19 09:07:59 | stdout | #5 0x55e2551a6ded  2023/10/19 09:07:59 | stdout | #4 0x55e2551b98fb  2023/10/19 09:07:59 | stdout | #3 0x55e25518381e  2023/10/19 09:07:59 | stdout | #2 0x55e25514f016  2023/10/19 09:07:59 | stdout | #1 0x55e2554073b3  2023/10/19 09:07:59 | stdout | #0 0x55e2554677f9  2023/10/19 09:07:59 | stdout | Stacktrace: 2023/10/19 09:07:59 | stdout | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:07:59 | stdout | 2023-10-19 09:07:59  [ERROR   ] ---- Webdriver quit abnormly, reason: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:07:59 | stderr | #3 0x55e25518381e  2023/10/19 09:07:59 | stderr | #2 0x55e25514f016  2023/10/19 09:07:59 | stderr | #1 0x55e2554073b3  2023/10/19 09:07:59 | stderr | #0 0x55e2554677f9  2023/10/19 09:07:59 | stderr | Stacktrace: 2023/10/19 09:07:59 | stderr | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:07:59 | stderr | selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:07:59 | stderr | raise exception_class(message, screen, stacktrace) 2023/10/19 09:07:59 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/errorhandler.py", line 243, in check_response 2023/10/19 09:07:59 | stderr | self.error_handler.check_response(response) 2023/10/19 09:07:59 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 429, in execute 2023/10/19 09:07:59 | stderr | return self.execute(Command.FIND_ELEMENT, { 2023/10/19 09:07:59 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 856, in find_element 2023/10/19 09:07:59 | stderr | captcha_element = driver.find_element(By.CLASS_NAME, "code-mask") 2023/10/19 09:07:59 | stderr | File "/app/data_fetcher.py", line 152, in _login 2023/10/19 09:07:59 | stderr | self._login(driver) 2023/10/19 09:07:59 | stderr | File "/app/data_fetcher.py", line 107, in _fetch 2023/10/19 09:07:59 | stderr | return self._fetch() 2023/10/19 09:07:59 | stderr | File "/app/data_fetcher.py", line 90, in fetch 2023/10/19 09:07:59 | stderr | Traceback (most recent call last): 2023/10/19 09:06:52 | stdout | 2023-10-19 09:06:52  [INFO    ] ---- Webdriver initialized. 2023/10/19 09:06:32 | stdout | . 3 retry times left. 2023/10/19 09:06:32 | stdout | #20 0x7f22b86fc06f clone 2023/10/19 09:06:32 | stdout | #19 0x7f22b94a5fa3 start_thread 2023/10/19 09:06:32 | stdout | #18 0x55b4f4a61a1f  2023/10/19 09:06:32 | stdout | #17 0x55b4f4a49778  2023/10/19 09:06:32 | stdout | #16 0x55b4f4a495d2  2023/10/19 09:06:32 | stdout | #15 0x55b4f4a17e00  2023/10/19 09:06:32 | stdout | #14 0x55b4f4a325b9  2023/10/19 09:06:32 | stdout | #13 0x55b4f4a3613a  2023/10/19 09:06:32 | stdout | #12 0x55b4f4a319e4  2023/10/19 09:06:32 | stdout | #11 0x55b4f4a31ce7  2023/10/19 09:06:32 | stdout | #10 0x55b4f4a22542  2023/10/19 09:06:32 | stdout | #9 0x55b4f47694d2  2023/10/19 09:06:32 | stdout | #8 0x55b4f4767ce4  2023/10/19 09:06:32 | stdout | #7 0x55b4f4795c93  2023/10/19 09:06:32 | stdout | #6 0x55b4f47a69e1  2023/10/19 09:06:32 | stdout | #5 0x55b4f4795ded  2023/10/19 09:06:32 | stdout | #4 0x55b4f47a88fb  2023/10/19 09:06:32 | stdout | #3 0x55b4f477281e  2023/10/19 09:06:32 | stdout | #2 0x55b4f473e016  2023/10/19 09:06:32 | stdout | #1 0x55b4f49f63b3  2023/10/19 09:06:32 | stdout | #0 0x55b4f4a567f9  2023/10/19 09:06:32 | stdout | Stacktrace: 2023/10/19 09:06:32 | stderr |   2023/10/19 09:06:32 | stderr | #20 0x7f22b86fc06f clone 2023/10/19 09:06:32 | stderr | #19 0x7f22b94a5fa3 start_thread 2023/10/19 09:06:32 | stderr | #18 0x55b4f4a61a1f  2023/10/19 09:06:32 | stderr | #17 0x55b4f4a49778  2023/10/19 09:06:32 | stderr | #16 0x55b4f4a495d2  2023/10/19 09:06:32 | stderr | #15 0x55b4f4a17e00  2023/10/19 09:06:32 | stderr | #14 0x55b4f4a325b9  2023/10/19 09:06:32 | stderr | #13 0x55b4f4a3613a  2023/10/19 09:06:32 | stderr | #12 0x55b4f4a319e4  2023/10/19 09:06:32 | stderr | #11 0x55b4f4a31ce7  2023/10/19 09:06:32 | stderr | #10 0x55b4f4a22542  2023/10/19 09:06:32 | stderr | #9 0x55b4f47694d2  2023/10/19 09:06:32 | stderr | #8 0x55b4f4767ce4  2023/10/19 09:06:32 | stdout | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:06:32 | stdout | 2023-10-19 09:06:32  [ERROR   ] ---- Webdriver quit abnormly, reason: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:06:32 | stderr | #7 0x55b4f4795c93  2023/10/19 09:06:32 | stderr | #6 0x55b4f47a69e1  2023/10/19 09:06:32 | stderr | #5 0x55b4f4795ded  2023/10/19 09:06:32 | stderr | #4 0x55b4f47a88fb  2023/10/19 09:06:32 | stderr | #3 0x55b4f477281e  2023/10/19 09:06:32 | stderr | #2 0x55b4f473e016  2023/10/19 09:06:32 | stderr | #1 0x55b4f49f63b3  2023/10/19 09:06:32 | stderr | #0 0x55b4f4a567f9  2023/10/19 09:06:32 | stderr | Stacktrace: 2023/10/19 09:06:32 | stderr | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:06:32 | stderr | selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:06:32 | stderr | raise exception_class(message, screen, stacktrace) 2023/10/19 09:06:32 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/errorhandler.py", line 243, in check_response 2023/10/19 09:06:32 | stderr | self.error_handler.check_response(response) 2023/10/19 09:06:32 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 429, in execute 2023/10/19 09:06:32 | stderr | return self.execute(Command.FIND_ELEMENT, { 2023/10/19 09:06:32 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 856, in find_element 2023/10/19 09:06:32 | stderr | captcha_element = driver.find_element(By.CLASS_NAME, "code-mask") 2023/10/19 09:06:32 | stderr | File "/app/data_fetcher.py", line 152, in _login 2023/10/19 09:06:32 | stderr | self._login(driver) 2023/10/19 09:06:32 | stderr | File "/app/data_fetcher.py", line 107, in _fetch 2023/10/19 09:06:32 | stderr | return self._fetch() 2023/10/19 09:06:32 | stderr | File "/app/data_fetcher.py", line 90, in fetch 2023/10/19 09:06:32 | stderr | Traceback (most recent call last): 2023/10/19 09:05:25 | stdout | 2023-10-19 09:05:25  [INFO    ] ---- Webdriver initialized. 2023/10/19 09:05:14 | stdout | . 4 retry times left. 2023/10/19 09:05:14 | stdout | #20 0x7fa37596706f clone 2023/10/19 09:05:14 | stdout | #19 0x7fa376710fa3 start_thread 2023/10/19 09:05:14 | stdout | #18 0x563a526f2a1f  2023/10/19 09:05:14 | stdout | #17 0x563a526da778  2023/10/19 09:05:14 | stdout | #16 0x563a526da5d2  2023/10/19 09:05:14 | stdout | #15 0x563a526a8e00  2023/10/19 09:05:14 | stdout | #14 0x563a526c35b9  2023/10/19 09:05:14 | stdout | #13 0x563a526c713a  2023/10/19 09:05:14 | stdout | #12 0x563a526c29e4  2023/10/19 09:05:14 | stdout | #11 0x563a526c2ce7  2023/10/19 09:05:14 | stdout | #10 0x563a526b3542  2023/10/19 09:05:14 | stdout | #9 0x563a523fa4d2  2023/10/19 09:05:14 | stdout | #8 0x563a523f8ce4  2023/10/19 09:05:14 | stdout | #7 0x563a52426c93  2023/10/19 09:05:14 | stdout | #6 0x563a524379e1  2023/10/19 09:05:14 | stdout | #5 0x563a52426ded  2023/10/19 09:05:14 | stdout | #4 0x563a524398fb  2023/10/19 09:05:14 | stdout | #3 0x563a5240381e  2023/10/19 09:05:14 | stdout | #2 0x563a523cf016  2023/10/19 09:05:14 | stdout | #1 0x563a526873b3  2023/10/19 09:05:14 | stdout | #0 0x563a526e77f9  2023/10/19 09:05:14 | stdout | Stacktrace: 2023/10/19 09:05:14 | stdout | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:05:14 | stdout | 2023-10-19 09:05:14  [ERROR   ] ---- Webdriver quit abnormly, reason: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:05:14 | stderr |   2023/10/19 09:05:14 | stderr | #20 0x7fa37596706f clone 2023/10/19 09:05:14 | stderr | #19 0x7fa376710fa3 start_thread 2023/10/19 09:05:14 | stderr | #18 0x563a526f2a1f  2023/10/19 09:05:14 | stderr | #17 0x563a526da778  2023/10/19 09:05:14 | stderr | #16 0x563a526da5d2  2023/10/19 09:05:14 | stderr | #15 0x563a526a8e00  2023/10/19 09:05:14 | stderr | #14 0x563a526c35b9  2023/10/19 09:05:14 | stderr | #13 0x563a526c713a  2023/10/19 09:05:14 | stderr | #12 0x563a526c29e4  2023/10/19 09:05:14 | stderr | #11 0x563a526c2ce7  2023/10/19 09:05:14 | stderr | #10 0x563a526b3542  2023/10/19 09:05:14 | stderr | #9 0x563a523fa4d2  2023/10/19 09:05:14 | stderr | #8 0x563a523f8ce4  2023/10/19 09:05:14 | stderr | #7 0x563a52426c93  2023/10/19 09:05:14 | stderr | #6 0x563a524379e1  2023/10/19 09:05:14 | stderr | #5 0x563a52426ded  2023/10/19 09:05:14 | stderr | #4 0x563a524398fb  2023/10/19 09:05:14 | stderr | #3 0x563a5240381e  2023/10/19 09:05:14 | stderr | #2 0x563a523cf016  2023/10/19 09:05:14 | stderr | #1 0x563a526873b3  2023/10/19 09:05:14 | stderr | #0 0x563a526e77f9  2023/10/19 09:05:14 | stderr | Stacktrace: 2023/10/19 09:05:14 | stderr | (Session info: headless chrome=90.0.4430.212) 2023/10/19 09:05:14 | stderr | selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":".code-mask"} 2023/10/19 09:05:14 | stderr | raise exception_class(message, screen, stacktrace) 2023/10/19 09:05:14 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/errorhandler.py", line 243, in check_response 2023/10/19 09:05:14 | stderr | self.error_handler.check_response(response) 2023/10/19 09:05:14 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 429, in execute 2023/10/19 09:05:14 | stderr | return self.execute(Command.FIND_ELEMENT, { 2023/10/19 09:05:14 | stderr | File "/usr/local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 856, in find_element 2023/10/19 09:05:14 | stderr | captcha_element = driver.find_element(By.CLASS_NAME, "code-mask") 2023/10/19 09:05:14 | stderr | File "/app/data_fetcher.py", line 152, in _login 2023/10/19 09:05:14 | stderr | self._login(driver) 2023/10/19 09:05:14 | stderr | File "/app/data_fetcher.py", line 107, in _fetch 2023/10/19 09:05:14 | stderr | return self._fetch() 2023/10/19 09:05:14 | stderr | File "/app/data_fetcher.py", line 90, in fetch 2023/10/19 09:05:14 | stderr | Traceback (most recent call last): 2023/10/19 09:04:08 | stdout | 2023-10-19 09:04:08  [INFO    ] ---- Webdriver initialized. 2023/10/19 09:03:57 | stdout | 2023-10-19 09:03:57  [INFO    ] ---- 此次为首次运行,等待时间(FIRST_SLEEP_TIME)为10秒,可在.env中设置 2023/10/19 09:03:57 | stdout | 2023-10-19 09:03:57  [INFO    ] ---- 当前登录的用户名为: 181****21,homeassistant地址为http://192.168.19.220:8123/,程序将在每天08:00执行 2023/10/19 09:03:57 | stdout | 2023-10-19 09:03:57  [INFO    ] ---- MongoDB connection test successful 2023/10/19 09:03:57 | stdout | 2023-10-19 09:03:57  [INFO    ] ---- chromium-driver version is 90 2023/10/19 09:03:57 | stdout | 2023-10-19 09:03:57  [INFO    ] ---- 程序开始,当前仓库版本为1.3.3,仓库地址为https://github.com/renhai-lab/sgcc_electricity

renhai-lab commented 11 months ago

是的,网页改了,目测是登陆验证换了。

Noah-Kent commented 11 months ago

确实,已经改验证了,感觉这种项目,电网很排斥,肯定会不停的防护。

renhai-lab commented 11 months ago

没发布此仓库之前一直稳定运行了半年,现在两三周就得维护了😢

tufeikafei commented 11 months ago

改成了滑动验证= = 这个方式 刚刚查了下,ddddocr 也支持滑动。。

renhai-lab commented 11 months ago

滑动验证好解决,但是没有时间频繁应对网站结构的改变,爬虫项目就是这样的很头痛。所以目前没有更新计划,想尝试的可以克隆仓库了自己试试。