bwbwbwbw / ingress-exporter

Export all portals, links, fields and system broadcasts in a specific area.
MIT License
84 stars 43 forks source link

after last change NIA version #24

Open sasha2002 opened 9 years ago

sasha2002 commented 9 years ago

Today IITC updated, please update the files, get "unknown server response", account is not banned, error persist on new account.

papuas commented 9 years ago

check account, i don't have this problems on new registered account.

sasha2002 commented 9 years ago

2015-02-17T15:35:22.172Z - info: [MungeDetector] Trying to use internal munge data. 2015-02-17T15:35:22.967Z - warn: [MungeDetector] Failed. 2015-02-17T15:35:22.968Z - info: [MungeDetector] Trying to extract munge data from ingress.com/intel. 2015-02-17T15:35:24.716Z - info: [MungeDetector] Detect successfully. 2015-02-17T15:35:24.725Z - info: [MungeDetector] Munge data saved. 2015-02-17T15:35:24.726Z - info: [AccountInfo] Fetching current account information... 2015-02-17T15:35:25.994Z - info: [AccountInfo] NICKNAME 2015-02-17T15:35:25.994Z - warn: [AccountInfo] Please immediately press Ctrl+C if you are using an incorrect account. 2015-02-17T15:35:26.736Z - info: [Broadcasts] Created 1113 tasks (all 1446 tasks). 2015-02-17T15:35:27.461Z - info: [Broadcasts] Begin requesting... 2015-02-17T15:35:28.740Z - info: [Broadcasts] [Feb 7th, 19:10:10 - Feb 7th, 19:20:10] 0% [1/1446] [1/1446] Received 10 (all 0) 2015-02-17T15:35:28.797Z - info: [Broadcasts] [Feb 7th, 17:00:10 - Feb 7th, 17:08:48] 0% [1/1446] [2/1447] Received 60 (all 98052) 2015-02-17T15:35:28.893Z - info: [Broadcasts] [Feb 8th, 01:00:10 - Feb 8th, 01:10:10] 0% [2/1446] [3/1447] Received 60 (all 98052) 2015-02-17T15:35:28.930Z - error: [Broadcasts] unknown server response 2015-02-17T15:35:28.931Z - info: [Broadcasts] [Feb 8th, 00:50:10 - Feb 8th, 01:00:10] 0% [2/1446] [4/1448] Received 60 (all 98052) 2015-02-17T15:35:28.953Z - info: [Broadcasts] [Feb 7th, 18:40:10 - Feb 7th, 18:49:29] 0% [2/1446] [5/1449] Received 110 (all 98112) 2015-02-17T15:35:29.221Z - error: [Broadcasts] unknown server response 2015-02-17T15:35:29.221Z - info: [Broadcasts] [Feb 8th, 01:20:10 - Feb 8th, 01:30:10] 0% [2/1446] [6/1450] Received 110 (all 98112)

breezewish commented 9 years ago

Hello, could you help me debug this problem? I don't have accounts currently. Just add one line to output NIA response in file src/lib/requestfactory.coffee

apply patch:

patch requestfactory.coffee < patch.txt

patch.txt

--- requestfactory.coffee   2015-02-19 20:18:21.000000000 +0800
+++ requestfactory.coffee   2015-02-19 20:19:43.000000000 +0800
@@ -198,6 +198,7 @@
             if body.trim().length is 0
                 return new Error 'Empty server response. Please try adding more accounts.'

+            logger.info body
             return new Error 'unknown server response'

         return null

remember to execute grunt after patching as well.

sasha2002 commented 9 years ago

after i patch :: 2015-02-19T13:40:18.270Z - info: [MungeDetector] Trying to use internal munge data. 2015-02-19T13:40:18.611Z - info: {} 2015-02-19T13:40:18.612Z - warn: [MungeDetector] Failed. 2015-02-19T13:40:18.612Z - info: [MungeDetector] Trying to extract munge data from ingress.com/intel. 2015-02-19T13:40:19.302Z - info: {} 2015-02-19T13:40:19.302Z - warn: [MungeDetector] Failed. 2015-02-19T13:40:19.303Z - error: [MungeDetector] Could not detect munge data. Tasks are terminated.

breezewish commented 9 years ago

Emm... unreasonable :-(

sasha2002 commented 9 years ago

I will try later, maybe this account was banned

sasha2002 commented 9 years ago

2015-02-20T09:12:55.961Z - info: [MungeDetector] Trying to use internal munge data. 2015-02-20T09:12:57.561Z - info: [MungeDetector] Detect successfully. 2015-02-20T09:12:57.561Z - info: [AccountInfo] Fetching current account information... 2015-02-20T09:12:59.081Z - info: [AccountInfo] ***** 2015-02-20T09:12:59.081Z - warn: [AccountInfo] Please immediately press Ctrl+C if you are using an incorrect account. 2015-02-20T09:12:59.370Z - info: [Faction] Created 6 tasks (all 77 tasks). 2015-02-20T09:12:59.408Z - info: [Faction] Begin requesting... 2015-02-20T09:13:00.072Z - info: [Faction] [Feb 10th, 21:30:11 - Feb 11th, 00:30:11] 1% [1/77] [1/77] Received 0 (all 0) 2015-02-20T09:13:00.282Z - info: [Faction] [Feb 19th, 15:30:11 - Feb 19th, 18:30:04] 3% [2/77] [2/77] Received 5 (all 0) 2015-02-20T09:13:00.336Z - info: {} 2015-02-20T09:13:00.337Z - error: [Faction] unknown server response 2015-02-20T09:13:00.337Z - info: [Faction] [Feb 11th, 09:30:11 - Feb 11th, 12:30:11] 3% [2/77] [3/78] Received 5 (all 676) 2015-02-20T09:13:00.459Z - info: [Faction] [Feb 11th, 06:30:11 - Feb 11th, 09:30:11] 4% [3/77] [4/78] Received 5 (all 676) 2015-02-20T09:13:00.547Z - info: {} 2015-02-20T09:13:00.548Z - error: [Faction] unknown server response 2015-02-20T09:13:00.548Z - info: [Faction] [Feb 11th, 12:30:11 - Feb 11th, 15:30:11] 4% [3/77] [5/79] Received 5 (all 676) 2015-02-20T09:13:00.559Z - info: [Faction] [Feb 11th, 03:30:11 - Feb 11th, 06:30:11] 5% [4/77] [6/79] Received 5 (all 676) 2015-02-20T09:13:00.562Z - info: [Faction] [Feb 11th, 00:30:11 - Feb 11th, 03:30:11] 6% [5/77] [7/79] Received 7 (all 676) 2015-02-20T09:13:00.691Z - info: {} 2015-02-20T09:13:00.692Z - error: [Faction] unknown server response 2015-02-20T09:13:00.692Z - info: [Faction] [Feb 11th, 15:30:11 - Feb 11th, 18:30:11] 6% [5/77] [8/80] Received 7 (all 676) 2015-02-20T09:13:00.753Z - info: {} 2015-02-20T09:13:00.753Z - error: [Faction] unknown server response 2015-02-20T09:13:00.754Z - info: [Faction] [Feb 11th, 18:30:11 - Feb 11th, 21:30:11] 6% [5/77] [9/81] Received 7 (all 676) 2015-02-20T09:13:00.855Z - info: {}

unbelievable

breezewish commented 9 years ago

so the server just response nothing LOL

sasha2002 commented 9 years ago

but if i log into web all is ok

sasha2002 commented 9 years ago

Fixed, account was soft banned, after login on ingress and wait 2 days all is ok. But we need to do something to bypass this lockout. @SummerWish maybe we can do a tool to use iitc and avoid this changes. To be clear :: If we use IITC all is ok, no soft-ban and another stuf. IITC load ingress site more quickly.

breezewish commented 9 years ago

Currently ingress exporter doesn't bypass botguard, that's why accounts are easily banned.

vavoluk commented 9 years ago

@SummerWish have any ideas how to bypass botguard? At now bots are banned after 50-100k records parsed.

sasha2002 commented 9 years ago

*****ck yeah :: 2015-02-22T22:51:33.082Z - info: [Broadcasts] [Feb 21st, 01:58:31 - Feb 21st, 02:08:31] 1% [3/283] [3/283] Received 0 (all 0) 2015-02-22T22:51:33.143Z - info: [Broadcasts] [Feb 21st, 02:28:31 - Feb 21st, 02:38:31] 1% [4/283] [4/283] Received 0 (all 0) 2015-02-22T22:51:33.593Z - info: [Broadcasts] [Feb 21st, 02:08:31 - Feb 21st, 02:18:31] 2% [5/283] [5/283] Received 0 (all 0) 2015-02-22T22:51:33.633Z - info: [Broadcasts] [Feb 21st, 02:38:31 - Feb 21st, 02:48:31] 2% [6/283] [6/283] Received 0 (all 0) 2015-02-22T22:51:33.682Z - info: [Broadcasts] [Feb 21st, 02:48:31 - Feb 21st, 02:58:31] 2% [7/283] [7/283] Received 0 (all 0) 2015-02-22T22:51:33.907Z - info: {} 2015-02-22T22:51:33.908Z - error: [Broadcasts] unknown server response 2015-02-22T22:51:33.908Z - info: [Broadcasts] [Feb 21st, 03:18:31 - Feb 21st, 03:28:31] 2% [7/283] [8/284] Received 0 (all 0) 2015-02-22T22:51:34.001Z - info: {} 2015-02-22T22:51:34.001Z - error: [Broadcasts] unknown server response 2015-02-22T22:51:34.002Z - info: [Broadcasts] [Feb 21st, 03:28:31 - Feb 21st, 03:38:31] 2% [7/283] [9/285] Received 0 (all 0) 2015-02-22T22:51:34.135Z - info: {} 2015-02-22T22:51:34.135Z - error: [Broadcasts] unknown server response 2015-02-22T22:51:34.135Z - info: [Broadcasts] [Feb 21st, 03:38:31 - Feb 21st, 03:48:31] 2% [7/283] [10/286] Received 0 (all 0) 2015-02-22T22:51:34.192Z - info: [Broadcasts] [Feb 21st, 02:58:31 - Feb 21st, 03:08:31] 3% [8/283] [11/286] Received 1 (all 149490) 2015-02-22T22:51:34.233Z - info: {} 2015-02-22T22:51:34.234Z - error: [Broadcasts] unknown server response Again, as said @vavoluk accounts a very quickly banned!!!

Can we use IITC or not?

geohas commented 9 years ago

ist there now any solution?