search

wololodev / d2mt

Competitive coverage on the go!
37 stars 11 forks source link

noo account suspended #20

Closed pedrolucasmag closed 9 years ago

pedrolucasmag commented 9 years ago

can you host it elsewhere ? X_X

wololodev commented 9 years ago

@MasterOdin extension down, unless it's a C&D/DMCA from joindota hehe

anyways, hosting is not free unless someone is able to provide this

Dios commented 9 years ago

you should do a kickstarter and post it in reddit.

MasterOdin commented 9 years ago

Service restored. It seems like someone was running our API scripts directly instead of consuming the .json files causing an excessive CPU load. So I've limited access to the scripts themselves to just d2mt which made the hosting happy.

The json files are still publicly available however.

wololodev commented 9 years ago

@trevorstarick actually changed hosts to DO yesterday since I thought u were off and gone haha. Should be fine for now, but im interested on who was directly consuming the scripts API directly (unless it was some user who just wanted the updates to happen more frequently).

Also for the new DO instance, the moment u push something to this repo, the prod server will automatically pull the same instance, so pls test :)

MasterOdin commented 9 years ago

Doesn't seem like pushing to the repo pushes the scripts to the production server as dotaprj.me/api/jd/matches/v130 should be working right now after my latest commit.

trevorstarick commented 9 years ago

I will set something up today to do that.

wololodev commented 9 years ago

does ur patch also fix gosugamers @MasterOdin ? we'll get on the automatic pulling in moments

MasterOdin commented 9 years ago

No. GosuGamers implemented some method of cookie checking that causes an error page to be returned when you query it. Not sure if you could set a cookie for the scraper/server to use?

wololodev commented 9 years ago

if a human can access their page, than any bot can access their page. Shouldn't be a problem, it's just I don't have time to look at this (the whole thing pretty much needs a rewritten (backend and frontend))

trevorstarick commented 9 years ago

Pushed the pull.php script and pulled it to the server. Once @wololodev sets up the webhook we should be golden. Currently I'm not anticipating it to need the secret parameter but I can add that later in a config file I guess.

puffff commented 9 years ago

the v2 gg api seems to be working

wololodev commented 9 years ago

@puffff you mean seems to be NOT* working?

puffff commented 9 years ago

@wololodev i tested it locally and it's working

MasterOdin commented 9 years ago

It has to do with how the request is sent between the two. The "newer" api still uses file_get_contents which may or may not be blocked (it was on the last web host) while all other api calls use curl. I'd prefer to just to get cURL to work again and not downgrade.

wololodev commented 9 years ago

so IP is blocked then, fgc and CURL, or even the pecl htp library won't differ

wololodev commented 9 years ago

ok, im not sure about cookies being a issue here lol. but PHP has runtime error for this script that the extension is consuming: http://api.dotaprj.me/gg/matches/v120/index.php (writes to http://api.dotaprj.me/gg/matches/v120/api.json)

MasterOdin commented 9 years ago

Closing this as point of re-opening it was fixed. Also as GG api currently works, just not how I'd prefer.