search

gitcoinco / web

Grow Open Source
https://gitcoin.co
Other
1.79k stars 772 forks source link

workaround poloniex captcha #237

Closed owocki closed 4 years ago

owocki commented 6 years ago

per https://github.com/gitcoinco/web/pull/158#issuecomment-357731863 :

./manage.py gas_prices command won't populate data now because the URL -- https://poloniex.com/public?command=returnTicker is now using Google Captcha which cannot be bypassed programatically I guess.

owocki commented 6 years ago 
kevinowocki@local /Users/kevinowocki/Sites/gitcoin/web/app~ % ./manage.py get_prices           (git)-[standard_bounties_integration] :
/Library/Python/2.7/site-packages/rest_framework/routers.py:23: RemovedInDjango20Warning: Importing from django.core.urlresolvers is deprecated in favor of django.urls.
  from django.core.urlresolvers import NoReverseMatch
ED
Attempting to connect to etherdelta API websocket...
Sending getMarket message...
Sent getMarket message! Waiting on proper response...
1
2
3
'returnTicker'
polo
Poloniex: SC=>BTC:3.925e-06
Poloniex: FLO=>BTC:1.876e-05
Poloniex: STR=>USDT:0.63881767
Poloniex: BELA=>BTC:3.3035e-05
Poloniex: DCR=>BTC:0.00793894
Poloniex: DASH=>BTC:0.07095476
Poloniex: LBC=>BTC:7.778e-05
Poloniex: DGB=>BTC:6.54e-06
Poloniex: GAS=>BTC:0.00581892
Poloniex: BCH=>BTC:0.176024815
Poloniex: XMR=>BTC:0.030150095
Poloniex: BLK=>XMR:0.00206654
Poloniex: GNO=>BTC:0.02358096
Poloniex: FLDC=>BTC:4.315e-06
Poloniex: VRC=>BTC:0.000132915
Poloniex: ZEC=>XMR:1.565070675
Poloniex: HUC=>BTC:2.9195e-05
Poloniex: ETH=>BTC:0.09381439
Poloniex: NAV=>BTC:0.000287425
Poloniex: XCP=>BTC:0.00385564
Poloniex: LSK=>ETH:0.022371455
Poloniex: CVC=>ETH:0.00078459
Poloniex: LTC=>USDT:237.67719592
Poloniex: XEM=>BTC:0.00010137
Poloniex: EMC2=>BTC:5.623e-05
Poloniex: BURST=>BTC:5.505e-06
Poloniex: ETH=>USDT:1305.14182166
Poloniex: SBD=>BTC:0.00043431
Poloniex: XMR=>USDT:421.0059
Poloniex: MAID=>XMR:0.002476285
Poloniex: ZRX=>ETH:0.00134864
Poloniex: PPC=>BTC:0.000536915
Poloniex: RADS=>BTC:0.000950005
Poloniex: NXT=>USDT:0.433500005
Poloniex: XRP=>USDT:1.800899945
Poloniex: LTC=>BTC:0.017055015
Poloniex: GNT=>ETH:0.00072774
Poloniex: BTCD=>BTC:0.01721179
Poloniex: GNO=>ETH:0.250225545
Poloniex: STR=>BTC:4.589e-05
Poloniex: NEOS=>BTC:0.00090753
Poloniex: XPM=>BTC:8.2e-05
Poloniex: BCN=>XMR:2.332e-05
Poloniex: ETC=>BTC:0.002994605
Poloniex: RIC=>BTC:3.6245e-05
Poloniex: STRAT=>BTC:0.001511015
Poloniex: ETC=>USDT:41.665451925
Poloniex: PASC=>BTC:0.00028805
Poloniex: BTC=>USDT:13928.2597999
Poloniex: CVC=>BTC:7.483e-05
Poloniex: BTM=>BTC:0.00020182
Poloniex: REP=>ETH:0.070182185
Poloniex: PINK=>BTC:4.49e-06
Poloniex: SYS=>BTC:6.4665e-05
Poloniex: LTC=>XMR:0.56673667
Poloniex: BCH=>ETH:1.873199
Poloniex: GAS=>ETH:0.061745165
Poloniex: NXC=>BTC:4.4035e-05
Poloniex: REP=>USDT:91.313399145
Poloniex: VIA=>BTC:0.000435235
Poloniex: OMG=>ETH:0.017686835
Poloniex: OMG=>BTC:0.001652265
Poloniex: VTC=>BTC:0.00040949
Poloniex: ETC=>ETH:0.031993685
Poloniex: BCH=>USDT:2450.86455548
Poloniex: DASH=>USDT:989.111492815
Poloniex: REP=>BTC:0.006534315
Poloniex: STEEM=>ETH:0.00435044
Poloniex: STEEM=>BTC:0.00040906
Poloniex: NXT=>XMR:0.001042965
Poloniex: XBC=>BTC:0.010702015
Poloniex: LSK=>BTC:0.00209232
Poloniex: EXP=>BTC:0.0005369
Poloniex: ARDR=>BTC:0.000108265
Poloniex: GNT=>BTC:6.892e-05
Poloniex: FCT=>BTC:0.00435505
Poloniex: BCY=>BTC:0.00010606
Poloniex: BCN=>BTC:6.95e-07
Poloniex: ZEC=>BTC:0.047132485
Poloniex: GAME=>BTC:0.000425775
Poloniex: CLAM=>BTC:0.000818065
Poloniex: XVC=>BTC:7.5255e-05
Poloniex: BTCD=>XMR:0.574795235
Poloniex: STORJ=>BTC:0.00013681
Poloniex: MAID=>BTC:7.408e-05
Poloniex: BTS=>BTC:3.809e-05
Poloniex: ZRX=>BTC:0.000126855
Poloniex: NMC=>BTC:0.00042387
Poloniex: NXT=>BTC:3.1235e-05
Poloniex: AMP=>BTC:6.462e-05
Poloniex: BLK=>BTC:6.152e-05
Poloniex: OMNI=>BTC:0.005525505
Poloniex: XRP=>BTC:0.0001294
Poloniex: POT=>BTC:2.2325e-05
Poloniex: ZEC=>USDT:653.464197595
Poloniex: GRC=>BTC:1.0875e-05
Poloniex: DASH=>XMR:2.3709862
Poloniex: DOGE=>BTC:7.55e-07
Poloniex: ZEC=>ETH:0.50099877

quite curious that this runs locally for me though..

owocki commented 6 years ago

@eswarasai what do you see when you run the mgmt command?

eswarasai commented 6 years ago

@owocki -- I've done some little research on the Poloniex Captcha issue. There's a security layer added which doesn't allow Public API calls if the Request IP Address falls out of some specific range/region. That could be the reason why it is working in US and not in India.

If I try to open the page -- https://poloniex.com/public?command=returnTicker in a browser, it shows me Captcha which wouldn't be the case for Users trying out in US.

poloniex
owocki commented 6 years ago

interesting...

do you have a VPN you could use to pull the data and get around the issue in https://github.com/gitcoinco/web/pull/158#issuecomment-357731863 ? if not, i could probably just run a postgres dump of my local DB and give you that

eswarasai commented 6 years ago

I don't have a VPN account. It'd be great if you can share the dump of local DB with me. Thanks.

owocki commented 6 years ago

@eswarasai sending it to u on slack now

kuhnchris commented 5 years ago

Anyone knows if those restrictions are still in place?