favll / pogom

The fastest Pokémon Go Map available.
MIT License
550 stars 199 forks source link

No Pokemon returned due to soft ban #152

Open Matsu16 opened 8 years ago

Matsu16 commented 8 years ago

No pokemon. 2 minutes ago it was still working. whats going on. no errors ..scans are just fine

Matsu16 commented 8 years ago

Is there a way to change the delay?

dikkedeur commented 8 years ago

added now 21 accounts to my list, and i see only this now

2016-08-09 20:49:33,732 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:33,733 [ scan] [ INFO] Completed 39.24% of scan. 2016-08-09 20:49:33,792 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:33,793 [ scan] [ INFO] Completed 39.30% of scan. 2016-08-09 20:49:34,125 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:34,126 [ scan] [ INFO] Completed 39.35% of scan. 2016-08-09 20:49:34,188 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:34,189 [ scan] [ INFO] Completed 39.41% of scan. 2016-08-09 20:49:34,285 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:34,285 [ scan] [ INFO] Completed 39.46% of scan. 2016-08-09 20:49:34,356 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:34,357 [ scan] [ INFO] Completed 39.52% of scan. 2016-08-09 20:49:34,452 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:34,452 [ scan] [ INFO] Completed 39.58% of scan. 2016-08-09 20:49:34,552 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:34,552 [ scan] [ INFO] Completed 39.63% of scan. 2016-08-09 20:49:34,627 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:34,627 [ scan] [ INFO] Completed 39.69% of scan. 2016-08-09 20:49:34,776 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 20:49:34,777 [ scan] [ INFO] Completed 39.74% of scan. 2016-08-09 20:49:34,896 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited?

so it seems that more accounts does more harm.. i will try smaller and more areas to see if that makes a difference.

CRoosa commented 8 years ago

I'm having the same issue as the above poster. Let me know if there are any logs or anything I can provide or any testing I can do to be of help.

Thanks

djv2 commented 8 years ago

@dikkedeur more is not 21...more is a 100+. if 21 are softbanned and you add another 5 those might get softbanned quickly too so are basically useless. if you add 100, you will have some to spare

dikkedeur commented 8 years ago

@djv2 i understand your point, my test was more to see if you get more of those errors when adding more accounts. at this point it seems so, and you can then add 100+ accounts, but then it will be a matter of time since they are softbanned as well.

at this point it seems that less accounts means more accurate data, but crapload of time if the radius is too big.. more accounts will get you under the radar of nia protection it seems.

Matsu16 commented 8 years ago

@dikkedeur i got 500 accounts on 5km All giving the same error after a while(20 min) not showing any pokemons anymore.

I was using the ahaa map before but adding more accounts was making it slower.

Iam not an expert but all the maps online got issues atm

dikkedeur commented 8 years ago

i got now 54 accounts on a 2700 meter radius, and it filled up and after a few cycles it all disappears.. and all i get is ING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:14,880 [ scan] [ INFO] Completed 95.14% of scan. 2016-08-09 22:03:14,963 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:14,963 [ scan] [ INFO] Completed 95.19% of scan. 2016-08-09 22:03:15,146 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:15,146 [ scan] [ INFO] Completed 95.25% of scan. 2016-08-09 22:03:15,229 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:15,229 [ scan] [ INFO] Completed 95.30% of scan. 2016-08-09 22:03:15,236 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:15,237 [ scan] [ INFO] Completed 95.36% of scan. 2016-08-09 22:03:15,374 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:15,375 [ scan] [ INFO] Completed 95.42% of scan. 2016-08-09 22:03:15,397 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:15,398 [ scan] [ INFO] Completed 95.47% of scan. 2016-08-09 22:03:15,408 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:15,408 [ scan] [ INFO] Completed 95.53% of scan. 2016-08-09 22:03:15,554 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:15,555 [ scan] [ INFO] Completed 95.58% of scan. 2016-08-09 22:03:15,563 [ models] [WARNING] Received valid response but without any data. Possibly rate-limited? 2016-08-09 22:03:15,563 [ scan] [ INFO] Completed 95.64% of scan.

and it is going beserk, meaning everything is being dropped.

so more accounts does not work in general ^^

fourthespada commented 8 years ago

I tried both, adding more accounts and less accounts, latest branch of pogom seems to be hammering niantic servers. It'll work with a fresh account+IP for a little bit...

I suspect this is contributing to the issue above... can we try a scan delay and see if that helps?

I'm really confused now because the frontpage says we can only scan every 10s, but trying to scan a single 100m spot the application keeps redoing search every 1-2s.

djv2 commented 8 years ago

@dikkedeur more accounts DOES work, you are not going big enough. i'm doing 200 > 400 > 600 accounts on 10000m scans for testing purposes and it gets better

@fourthespada i noticed that too and suspect a lie. i don't think this has a 10s delay at all

Matsu16 commented 8 years ago

@djv running 500 accounts on 5000m. That should be enough right? . Still no pokemon after a while.

djv2 commented 8 years ago

@Matsu16 yes more than enough. try changing your IP via VPN, that usually helps me. if that still doesn't work, then you must wait. time heals bans

dikkedeur commented 8 years ago

running 64 accounts on 200 meters got same result... you can say what you want it runs first time skipping right away alot of request and with a few spins its over.. everything will be blocked. the best method i found so far is.

multiple small areas, with low amount of accounts, that way i do get some data, not everything but you get the remaining ( hopefully ) on the next spin.

dikkedeur commented 8 years ago

still making accounts right now, so lets see if i put 100 accounts on a very small area..

Matsu16 commented 8 years ago

@dikkedeur what is small? 500m?

dikkedeur commented 8 years ago

@Matsu16 at this moment i do 300 meter areas.

johved commented 8 years ago

I had 14 accounts on 2x 1000m and 1x 600m in close proximity to each otherand that worked fine without the rate-limit errors. But then i escalated to 56 accounts on a couple more locations and now every account is soft-banned/IP-banned/whatever this is. And no pokemons at all on the map. I'll try removing the added locations to see if the three previous locations works with the added accounts image

djv2 commented 8 years ago

@dikkedeur you = small. i don't get why you don't go BIG. when you say you increase in size you are adding like 10-20. i'm adding 100+. you must be like the only person here under 100. also you need to wait. more than likely your old accounts aren't unbanned yet so when you add another ~20 it's only scanning with those new 20 and not the total ~100 whatever. you really need to stop taking tiny baby steps!!

compuguy commented 8 years ago

@djv2 @dikkedeur I honestly am not covering a huge area to begin with, hence why I was only initially shooting for just 10 accounts. I'm currently at 21-22 accounts.

johved commented 8 years ago

It's been about 30mins since the rate-limits started and the recent minutes the errors has been fewer as fewer accounts are still soft-banned. So it seems that the three locations i mentioned works with 56 accounts.

How excatly does the scanning cycle run? Does the scanning complete one location and then continuing with the next and then the next in line and so forth? Would it help to make a "circle" of locations (in order, from start to finish) so that the accounts jump the least distance each time?

totoberg123 commented 8 years ago

@dikkedeur you use a tool to create accounts?

TravisDean commented 8 years ago

@totoberg123 I used https://github.com/skvvv/pikapy to make them. Working on a multithreading update right now; gave me ~200 accounts in like 3 minutes with that addition.

Jones1337 commented 8 years ago

my ~200 accs were softbanned aswell :/ how long is the duration of a softban

Jones1337 commented 8 years ago

Is there probably any chance to fix this? What do you think?

phantomvamp commented 8 years ago

I created an account on this just so i could post, but from what it seems like there is too many scans going at once and/or going too fast. I modified scan.py and changed the time.sleep.

Line: 122 from: time.sleep(5) to: time.sleep(8)

After I restarted the app, I am getting a lot less errors. I know close to nothing about coding, and was poking around it a bit. Who knows, it could have absolutely nothing to do with getting less errors.

M0pp0r commented 8 years ago

I too get the rate limit error. But I dont seem to get less pokemon. I have 250 accs for 1x1800m and 1x800m radius scan. I have a scanner app with 18 differnt accs and do cross chekcs with Pogom and both show the same amount of Pokemon. I get many errors but still get new pokemons. So going Big might be the way to go

Baklap4 commented 8 years ago

@TravisDean how do you multithread with the program?

dikkedeur commented 8 years ago

Okay for the love of god and testing purposes ^^ here we go.

Area 2700 meters, makes my whole city covered.. 383 accounts ( yes @djv2 i think big enough? ^^ ) First scan was going awesome rapidly.. it was not even done logging in all the accounts when he did a rescan... all went very well, but after 3 scans of the area it dropped all accounts one at a time.. Threads where 10...

Now that all my accounts where so called softbanned i made 1 new account ^^ entered that in the config... started the map Instant banned. well not banned since you get the login successfull.

so what nia does is when a lot of requests comes from 1 ip, not ban the accounts, but dropping the requests from the IP. its NOT an IP ban, thats different, since then you would not even be able to authenticate your accounts. What Nia does is just sending empty packets back due you overflooding the server with requests.

I changed in scan.py time.sleep(5) to time.sleep(250) but that didnt work... im not a programmer..

phantomvamp commented 8 years ago

I only have 3 threads, no idea how to increase it to see if I add more will i get that warning message more often.

T3RRR commented 8 years ago

I think that I just hit a IP ban.

I was running the map with 100 accounts it was doing fine till I get zero pokes on the map. I tried using my phone to see with the same wifi connected its returning zero pokes in the sighting (I am pretty sure there are pokes around my area. I even verify it by disconnecting with my wifi and using my phone data, the pokemon came back to the sightings)

So I reset my router IP and everything works normally again. the map starts getting pokes and my phone start seeing pokemon in the sightings.

I guess nia is getting on our asses again ?

dikkedeur commented 8 years ago

okay after all my requests being denied by nia, i changed back to a small area with only 1 account. this was just to see how long it would take before Nia would accept new connections from my ip. its roughly 1 hour and now suddenly Nia accepts my requests again.

2016-08-10 12:24:14,328 [ scan] [ INFO] Completed 3.53% of scan. 2016-08-10 12:24:24,512 [ scan] [ INFO] Completed 4.71% of scan. 2016-08-10 12:24:34,687 [ scan] [ INFO] Completed 5.88% of scan. 2016-08-10 12:24:45,187 [ scan] [ INFO] Completed 7.06% of scan. 2016-08-10 12:24:55,357 [ scan] [ INFO] Completed 8.24% of scan. 2016-08-10 12:25:05,529 [ scan] [ INFO] Completed 9.41% of scan. 2016-08-10 12:25:15,715 [ scan] [ INFO] Completed 10.59% of scan. 2016-08-10 12:25:26,130 [ scan] [ INFO] Completed 11.76% of scan.

so when you have hit the fan ^^ wait 1 hour, and you are good to go.

Matsu16 commented 8 years ago

Yeah but after this hour there will be a block in ten minutes so the map is worthless right now.

dikkedeur commented 8 years ago

totally true.. well not if you scan with 1 account, but it destroys the purpose of fast scanning large areas.. for me it works with a small area of 600 meters, it scans it with 1 account in about 15 minutes... i do get data back, i might miss here and there some spawns.. but its better then nothing at this moment.

johved commented 8 years ago

image This setup works for me with 100 accounts. some of them gets soft-banned but it works. The largest area is around 1km

dikkedeur commented 8 years ago

how big are you areas ??

johved commented 8 years ago

@dikkedeur the largest ones are just around 1000m i think. I think it helps to have the one in the middle to be the first location you add.

Matsu16 commented 8 years ago

Eventually your accounts will all be blocked. It doenst mather how u setup .. Too many requests from an ip will get it blocked

eXeLe commented 8 years ago

1066 accounts, last softban was after ~6minutes 18km radius (large city) running necrobot helps to determine softban - can't use pokestops can't find em at all

Matsu16 commented 8 years ago

I got it working with the ahaa map latest update. My entire city with 200 acc and ip change with vpn every 45 min.

Baklap4 commented 8 years ago

Then how to slow down those requests? It is known for a fact one cannot request more than once every 10 seconds?

Matsu16 commented 8 years ago

I dont think slowing down helps. The problem is too many accounts from 1 ip makes too many requests.

Baklap4 commented 8 years ago

But changing ip is not doable as server instance which has a static ip hmm without proxies or tor or something

eXeLe commented 8 years ago

Could be usefull info https://github.com/PokemonGoF/PokemonGo-Bot/issues/3217#issuecomment-238486087

May be we should try logging in all of the acoounts with some delay? Like 1 every 5 minutes. But it would be awfully slow =(

johved commented 8 years ago

@Matsu16 My setup has been running fine now for five hours when I started it.

Matsu16 commented 8 years ago

@johved explain ur setup. How many acc . Size etc

EiTeR94 commented 8 years ago

I got this same error now, and i can't see anything on my main account with phone on my home network. So it's an IP ban, now, is IP a perm ban or soft ban? anyone know about that?

001nathan100 commented 8 years ago

I just got IP banned with 14 accounts on 750m radius.

warshooter commented 8 years ago

How can you add a delay?

EiTeR94 commented 8 years ago

you have to modify scan.py on line 117

Matsu16 commented 8 years ago

@EiTeR94 soft ipban takes 1hour

dikkedeur commented 8 years ago

@EiTeR94 the ban will last 1 hour roughly