external mirrors of xvm's stat service

[GoogleCodeExporter]

how do you think about supporting some external mirrors of the stat-service?

i (and i guess several others) would gladly use one of my own servers to ease 
the load on your server, which appears to be having a rough time lately.

Original issue reported on code.google.com by benedikt...@gmail.com on 25 Jan 2014 at 6:16

[GoogleCodeExporter]

Original comment by pavlushko.m@gmail.com on 26 Jan 2014 at 2:18

[GoogleCodeExporter]

it's not hard to have a personal mirror.. I have one..
but it's not simple to stay rear WG changes :-P

Original comment by nuci...@gmail.com on 28 Jan 2014 at 5:26

[GoogleCodeExporter]

i did not intend to provide just a personal mirror, but a fully-functional 
mirror that is accessed by a certain amount of xvm's clients to balance the 
load on your servers.

either by having the clients chose a random server from a list, or by your 
server delegating the clients to an external mirror in case it cannot handle 
its load.

having a private mirror would solve the problem for me, but not for all the 
others. did you rebuild the mirror yourself based on xvm's requests, or did i 
just fail to find it in the repository?

Original comment by benedikt...@gmail.com on 28 Jan 2014 at 6:50

[GoogleCodeExporter]

>having a private mirror would solve the problem for me, but not for all the 
others. did you rebuild the mirror yourself based on xvm's requests, or did i 
just fail to find it in the repository?

https://bitbucket.org/iBat/nodejs-xvm-proxy/overview

Original comment by maca.pa...@gmail.com on 28 Jan 2014 at 6:53

[GoogleCodeExporter]

I'm using iBat's nodejs-xvm-proxy code.
I do not pay a powerful server, so I tuned for small amount of request.
Now I have 300~ unique users, mostly Italians because I shared modified 
constants.pyc with them and I'm deleting ids for others server (I keep only EU 
ids).
It's not a XVM team priority have a conf file where put different URL, so I 
downloaded and recompiled custom constants.py

Original comment by nuci...@gmail.com on 29 Jan 2014 at 12:43

[GoogleCodeExporter]

i had iBat's server running on a rather small VM and it worked pretty fine for 
me.

could you tell me the hardware specs which the proxy2.bulychev.net server is 
using? i cannot estimate how much memory your server will consume yet, since it 
naturally did not have a large pool of users and i am familiar with neither 
mongodb nor nodejs.

if the requierements are not insane and the traffic is not beyond 5 
terabyte/month, we would like to host a mirror at xvm.wottools.com, at least 
for the european server.

how do you like the general idea of supporting a certain list of officially 
approved mirrors? proxy2.bulychev.net appears to be down right now by the way ;)

Original comment by benedikt...@gmail.com on 7 Feb 2014 at 9:12

[GoogleCodeExporter]

Processing power should not be a problem for this type of application. And if 
it is one, I suggest rewriting the code into a real compiled language like C or 
C++ so only the network bandwidth would matter. 
The XVM server isn't using a relational database as far as I know so I think it 
would be worth it to write a custom storage system specifically for XVM, and 
port the NodeJS stuff into a FastCGI application that could be used by Nginx.
If the server is crashing/having difficulties because of the high load, this 
idea might be, in my opinion, the best solution.

But we don't have a lot of information of what is happening on the XVM server 
so maybe it's a completely different problem. Anyway, I'm sure a lot of people 
are willing to help, me included,; so feel free, Bat, to give us your opinion 
about our suggestions, and please keep us posted about servers issues (maybe 
there are more information on the RU forum but unfortunately, I don't speak 
russian...).

Original comment by edgar.fo...@gmail.com on 7 Feb 2014 at 9:33

[GoogleCodeExporter]

1. We have no problems with the server, and have enough free resources to serve 
more then 1200 requests per sec (our hystorical maximum was ~800 rq/s). We can 
rent another server when required.
2. We have no plans to use any 3rd-party server.

Original comment by m.schedr...@gmail.com on 7 Feb 2014 at 9:45

• Changed state: Done