search

makehackvoid / govhack2014preparation

Prepare for GovHack2014
MIT License
0 stars 0 forks source link

What packages are desired for the virtual machine PXE Boot image? #2

Open mbainrot opened 10 years ago

mbainrot commented 10 years ago

Hey all,

I've been working on setting up the virtual machine image (debian preseed automated install) and so far I got the following setup on the python image.

Python stuff and most other stuff is done in a "post install" stage of things. This means that basically the system reboots into linux and autologins in as root. It propmpts for desktop theme but so far it seems like it doesn't care if it's ignored, it just asks again on next login.

Jamie has suggested PyCharm, looking into how to install it now. Only going to provide the community version.

Ta, Max

B0073D commented 10 years ago

@mbainrot

I think it might be fine to leave pycharm off there. You can easily set up remotes in PyCharm (including ssh and file access etc) so I think this might be overkill. Additionally some people use the paid version.

To clarify, you can run your IDE (pycharm) and have it connect to your dev environment (the vm).

On Tue, Jun 17, 2014 at 10:58 AM, mbainrot notifications@github.com wrote:

Hey all,

I've been working on setting up the virtual machine image (debian preseed automated install) and so far I got the following setup on the python image.

  • python 2.7.7 (built from source)
  • pip (via get-pip.py)
  • ipython & ipython notebook
  • flask
  • vmware tools (vbox tools is a bit of a pig, more work needed on that front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage of things. This means that basically the system reboots into linux and autologins in as root. It propmpts for desktop theme but so far it seems like it doesn't care if it's ignored, it just asks again on next login.

Jamie has suggested PyCharm, looking into how to install it now. Only going to provide the community version.

Ta, Max

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2.

Sincerely,

Tim Suess

Alternative Thought

www.B0073D.com

jamiereid commented 10 years ago

I think it would be best to use Python3 if we are going to use python. Are you able to include it?

On Tue, Jun 17, 2014 at 11:05 AM, B0073D notifications@github.com wrote:

@mbainrot

I think it might be fine to leave pycharm off there. You can easily set up remotes in PyCharm (including ssh and file access etc) so I think this might be overkill. Additionally some people use the paid version.

On Tue, Jun 17, 2014 at 10:58 AM, mbainrot notifications@github.com wrote:

Hey all,

I've been working on setting up the virtual machine image (debian preseed automated install) and so far I got the following setup on the python image.

  • python 2.7.7 (built from source)
  • pip (via get-pip.py)
  • ipython & ipython notebook
  • flask
  • vmware tools (vbox tools is a bit of a pig, more work needed on that front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage of things. This means that basically the system reboots into linux and autologins in as root. It propmpts for desktop theme but so far it seems like it doesn't care if it's ignored, it just asks again on next login.

Jamie has suggested PyCharm, looking into how to install it now. Only going to provide the community version.

Ta, Max

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2.

Sincerely,

Tim Suess

Alternative Thought

www.B0073D.com

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46256770 .

mbainrot commented 10 years ago

@B0073D okies, I will leave the tar.gz in the http://192.168.0.1/res directory for those who want it (as not to contribute to the congestion on the tiny little internet connection at the facility)

Its actually really easy to setup (side effect of it's somewhat closed source nature maybe?) so should be OK.

B0073D commented 10 years ago

is flask and flask-peewee etc etc etc compatible with 3?

I'd maybe stick with 2.7 as there are more modules/tools are available. On 17/06/2014 11:09 AM, "Jamie Reid" notifications@github.com wrote:

I think it would be best to use Python3 if we are going to use python. Are you able to include it?

On Tue, Jun 17, 2014 at 11:05 AM, B0073D notifications@github.com wrote:

@mbainrot

I think it might be fine to leave pycharm off there. You can easily set up remotes in PyCharm (including ssh and file access etc) so I think this might be overkill. Additionally some people use the paid version.

On Tue, Jun 17, 2014 at 10:58 AM, mbainrot notifications@github.com wrote:

Hey all,

I've been working on setting up the virtual machine image (debian preseed automated install) and so far I got the following setup on the python image.

  • python 2.7.7 (built from source)
  • pip (via get-pip.py)
  • ipython & ipython notebook
  • flask
  • vmware tools (vbox tools is a bit of a pig, more work needed on that front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage of things. This means that basically the system reboots into linux and autologins in as root. It propmpts for desktop theme but so far it seems like it doesn't care if it's ignored, it just asks again on next login.

Jamie has suggested PyCharm, looking into how to install it now. Only going to provide the community version.

Ta, Max

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2.

Sincerely,

Tim Suess

Alternative Thought

www.B0073D.com

— Reply to this email directly or view it on GitHub < https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46256770>

.

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46256967 .

mbainrot commented 10 years ago

@jamiereid I thought we chose python 2.7 due to sockets/http? stuff still not marked as mature in python 3.0?

Alternatively is it possible to use both? or do they not get along/cause headaches? (pardon the lack of experience here, I am a .NET code monkey )

jamiereid commented 10 years ago

Yes. mhvdb2 is running on Python3

On Tue, Jun 17, 2014 at 11:12 AM, B0073D notifications@github.com wrote:

is flask and flask-peewee etc etc etc compatible with 3?

I'd maybe stick with 2.7 as there are more modules/tools are available. On 17/06/2014 11:09 AM, "Jamie Reid" notifications@github.com wrote:

I think it would be best to use Python3 if we are going to use python. Are you able to include it?

On Tue, Jun 17, 2014 at 11:05 AM, B0073D notifications@github.com wrote:

@mbainrot

I think it might be fine to leave pycharm off there. You can easily set up remotes in PyCharm (including ssh and file access etc) so I think this might be overkill. Additionally some people use the paid version.

On Tue, Jun 17, 2014 at 10:58 AM, mbainrot notifications@github.com wrote:

Hey all,

I've been working on setting up the virtual machine image (debian preseed automated install) and so far I got the following setup on the python image.

  • python 2.7.7 (built from source)
  • pip (via get-pip.py)
  • ipython & ipython notebook
  • flask
  • vmware tools (vbox tools is a bit of a pig, more work needed on that front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage of things. This means that basically the system reboots into linux and autologins in as root. It propmpts for desktop theme but so far it seems like it doesn't care if it's ignored, it just asks again on next login.

Jamie has suggested PyCharm, looking into how to install it now. Only going to provide the community version.

Ta, Max

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2.

Sincerely,

Tim Suess

Alternative Thought

www.B0073D.com

— Reply to this email directly or view it on GitHub <

https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46256770>

.

— Reply to this email directly or view it on GitHub < https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46256967>

.

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46257123 .

jamiereid commented 10 years ago

Ah, maybe I missed that part of the discussion the other night. @brendam do you remember if there was a reason for sticking with python2 as @mbainrot suggests?

On Tue, Jun 17, 2014 at 11:13 AM, mbainrot notifications@github.com wrote:

@jamiereid https://github.com/jamiereid I thought we chose python 2.7 due to sockets/http? stuff still not marked as mature in python 3.0?

Alternatively is it possible to use both? or do they not get along/cause headaches? (pardon the lack of experience here, I am a .NET code monkey )

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46257166 .

brendam commented 10 years ago

We did loose time last year to people having trouble getting a dev environment setup, so a VM is one way to fix that. But we can also help people get their dev environment setup ahead of time on their preferred OS this time. Still helpful to have a VM for people who don't want to do that.

But the other thing I'd like us to protect ourselves from is not having internet access, or slow internet, at the venue (just in case) - have a server we can collaborate on if the internet goes down. Possible things for it to do:

However, it is likely to be a fallback option so don't want to overdo what we have on it - what is the minimum that would be useful

On 17 June 2014 11:09, mbainrot notifications@github.com wrote:

@B0073D https://github.com/B0073D okies, I will leave the tar.gz in the http://192.168.0.1/res directory for those who want it (as not to contribute to the congestion on the tiny little internet connection at the facility)

Its actually really easy to setup (side effect of it's somewhat closed source nature maybe?) so should be OK.

Great idea to have install files for things in case the internet is slow.

regards,

Brenda

mbainrot commented 10 years ago

On the editor discussion, http://sourceforge.net/projects/bluefish/files/ what are peoples thoughts? its more of an "incluision", best of all its in the apt-repos so its addition is trivial

My personal preference is to use a VM, means I have a clean environment and I can work around the OS problems on my big notebook (looses network connectivity randomly)

Though if people have a working environment then i don't care :P provided I don't have to chase my tail because of "compiles on my computer, so must be your environment" syndrome :)

Happy to provide my seed and post install scripts if it'll help people setup their environments.

As for dealing with slow internet, we could always do a download wish list for large data sets and get someone with a silly fast internet connection to download and burn/copy to usb. Alternatively we could try and setup a wifi link back to the maker space.

edit: @brendam will look at implementing some caching for pip, apt and pypi (pip?) so when one adds a dependancy then we only have to slow download grind once

rx-gy commented 10 years ago

Is there still an intention to meet up this week? A USB drive with everything hooked up to a raspi as a server / WiFi dump may be a good option... On 17/06/2014 12:16 pm, "mbainrot" notifications@github.com wrote:

On the editor discussion, http://sourceforge.net/projects/bluefish/files/ what are peoples thoughts? its more of an "incluision", best of all its in the apt-repos so its addition is trivial

My personal preference is to use a VM, means I have a clean environment and I can work around the OS problems on my big notebook (looses network connectivity randomly)

Though if people have a working environment then i don't care :P provided I don't have to chase my tail because of "compiles on my computer, so must be your environment" syndrome :)

Happy to provide my seed and post install scripts if it'll help people setup their environments.

As for dealing with slow internet, we could always do a download wish list for large data sets and get someone with a silly fast internet connection to download and burn/copy to usb. Alternatively we could try and setup a wifi link back to the maker space.

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46260491 .

kaleyh commented 10 years ago

I'll look into setting up a local ci system (similar to Travis). On 17 Jun 2014 13:29, "Geoff" notifications@github.com wrote:

Is there still an intention to meet up this week? A USB drive with everything hooked up to a raspi as a server / WiFi dump may be a good option... On 17/06/2014 12:16 pm, "mbainrot" notifications@github.com wrote:

On the editor discussion, http://sourceforge.net/projects/bluefish/files/ what are peoples thoughts? its more of an "incluision", best of all its in the apt-repos so its addition is trivial

My personal preference is to use a VM, means I have a clean environment and I can work around the OS problems on my big notebook (looses network connectivity randomly)

Though if people have a working environment then i don't care :P provided I don't have to chase my tail because of "compiles on my computer, so must be your environment" syndrome :)

Happy to provide my seed and post install scripts if it'll help people setup their environments.

As for dealing with slow internet, we could always do a download wish list for large data sets and get someone with a silly fast internet connection to download and burn/copy to usb. Alternatively we could try and setup a wifi link back to the maker space.

— Reply to this email directly or view it on GitHub < https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46260491>

.

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46263805 .

mbainrot commented 10 years ago

On the topic of local ci, I found the Travis repo. So in theory we could setup a local ci for next year. But it is alot of work and I suspect it would need a fair whack of CPU as Travis uses virtual machines and the puppet like mechanism who's name escapes me

If we follow their structure and not combine services it's about 5-8 VMS with a fair bit of beef on 'em

kaleyh commented 10 years ago

VMs, with the advent of virtual extensions in CPUs, aren't that expensive. However, travis is waaay over the top for what you need. Simply use docker, and fire off a container everytime someone pushes to a git repo on the same server. Git hooks are your friend!

The information can be exposed via a simple HTTP API, just log the docker output to some files somewhere and have python read them out and summarise them to whoever wants it.

Would take some time to setup, but it is really flexible and means that you have an efficient system that doesn't use much in hardware resources.

On Wed, Aug 13, 2014 at 8:16 PM, mbainrot notifications@github.com wrote:

On the topic of local ci, I found the Travis repo. So in theory we could setup a local ci for next year. But it is alot of work and I suspect it would need a fair whack of CPU as Travis uses virtual machines and the puppet like mechanism who's name escapes me

If we follow their structure and not combine services it's about 5-8 VMS with a fair bit of beef on 'em

— Reply to this email directly or view it on GitHub https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-52031237 .