melrom
commented
11 years ago - 1st timers that have XSEDE accounts will use the XSEDE Redis Service - XRS (?) - (xrs.tacc.utexas.edu - TODO Yaakoub). If this works well, we will migrate (XSEDE) production users to this infrastructure as well. XSEDE should take administrative ownership of this service. This needs to be documented in the wiki once it's working (TODO: Melissa)
- 1st timers without XSEDE accounts will find a detailed example how to run their own Redis server on their local cluster head node (in user space). (TODO: Melissa). Basically, the tutorial needs a big 'fork' at the very beginning: if you have an XSEDE account, do this. If you don't have an XSEDE account, do this. It would also be good to have something like a BigJob manual (different from tutorial) that discusses deployment issues for production set-ups and so on.
- For BigJob tutorials and cross-ci experiments like ExTENCI, etc, we will continue to use the 'gw' machine. Due to low frequency, instances can be set up and configured manually on demand. The short term goal is to close 'gw' for 1st timers and the long term goal is to close it for production users as well (I will add this topic to the SAGA/RADICAL meetings for the next couple of weeks).
oleweidner
andre-merzky
Currently, we need to inform users of the need to use their own redis server to run BigJob. We also need to come to a concensus on the easiest way for users to start a redis server to do the tutorials.
Andre Merzky proposes a solution in an email entitled "REDIS redux"
To quote his email:
I wrote a small server which does exactly that: it creates redis instances on demand and returns its port and password. That instance is then killed after a certain time (by default 24 hours, but can be extended at will).
It should be quite easy to include that in the tutorials. For example:
echo "REDIS CREATE" | netcat -q 2 localhost 2000
201 creating redis instance '299ea641-94e0-4a2c-902b-f7000d8fd2b9': redis://localhost:10000/
gives a unique redis instance -- and it gets cleaned up after the tutorial. The instances are independent from each other, and as secure as any other redis installation (AFAICS).