search

socallinuxexpo / scale-network

SCaLE's on-site expo network configurations, wifi, tooling, and scripts
https://www.socallinuxexpo.org/
BSD 3-Clause "New" or "Revised" License
40 stars 16 forks source link

Additional virtual work party/training 'eliminate rob/owen being a SPOF' #723

Open davidelang opened 3 months ago

davidelang commented 3 months ago

Rob is becoming a SPOF, we need to train more people on how to do everything.

just saying 'it's in git' isn't enough.

davidelang commented 3 months ago

Owen is also a spof on all things switch releated, he started training Scott this year, but we need to expand the knowledge

This can start with documentation/videos, but at some point we need to do a live (could be through zoom) session to have people actually try to do the things.

owendelong commented 3 months ago

Everyone who attended my talk this evening got a good start on this.

Owen

On Mar 15, 2024, at 10:30, David Lang @.***> wrote:

Owen is also a spof on all things switch releated, he started training Scott this year, but we need to expand the knowledge

This can start with documentation/videos, but at some point we need to do a live (could be through zoom) session to have people actually try to do the things.

— Reply to this email directly, view it on GitHub https://github.com/socallinuxexpo/scale-network/issues/723#issuecomment-2000126413, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAK6GTXTQE3OGJRKFLIOSWTYYMV33AVCNFSM6AAAAABEYMLHE2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBQGEZDMNBRGM. You are receiving this because you are subscribed to this thread.

sarcasticadmin commented 3 months ago

@kylerisse and @ruebenramirez got onboarded this year for the server infrastructure.

@MrHamel has been a big help on the AP front and Im hoping we can work together more there through 2024

MrHamel commented 3 months ago

Owen isn't the only Juniper netadmin. My paid job is network engineering (and automation). Do I fully understand the convention center patching? No, however, I got better at handling the catwalk.

Anyway, below are a few ideas off the top of my head:

Add jumpboxes to the VM list to access various things. That way, we do not have to be on specific VLANs or need RPis setup in the NOC. Everything is an SSH session away (including various port forwards).

Could we also virtualize massflash to remove the laptop as a dependency? It requires a VLAN allocation, and the massflash switch would uplink to the NOC switch or whatever, instead of the laptop.

sarcasticadmin commented 3 months ago

Owen isn't the only Juniper netadmin. My paid job is network engineering (and automation). Do I fully understand the convention center patching? No, however, I got better at handling the catwalk.

:+1:

Anyway, below are a few ideas off the top of my head:

Add jumpboxes to the VM list to access various things. That way, we do not have to be on specific VLANs or need RPis setup in the NOC. Everything is an SSH session away (including various port forwards).

There are no vlan requirements in the NOC switch for infra vlan, its untagged. Everything is an SSH session away.

Could we also virtualize massflash to remove the laptop as a dependency? It requires a VLAN allocation, and the massflash switch would uplink to the NOC switch or whatever, instead of the laptop.

The massflash is a livecd, its can run on any x86 machine. The reason its this way is so we dont have to have the hypervisors for a work party. Ive considered the idea of included similar massflash configuration in the core machine but there needs to be more considerations before its implemented.

davidelang commented 3 months ago

On Thu, 21 Mar 2024, Robert James Hernandez wrote:

Could we also virtualize massflash to remove the laptop as a dependency? It requires a VLAN allocation, and the massflash switch would uplink to the NOC switch or whatever, instead of the laptop.

The massflash is a livecd, its can run on any x86 machine. The reason its this way is so we dont have to have the hypervisors for a work party. Ive considered the idea of included similar massflash configuration in the core machine but there needs to be more considerations before its implemented.

I would love to have massflash as a pi image as well.

given our experience this year of various things not working through dhcp relays, etc. I would really like us to be able to bring up a virual replica of the show at the work parties, including the hypervisors, routers, and layers of switches.

Being able to bring this up outside of work parties would be even better, but at least at our final work party, we should be able to try everything we are depending on for the show.

David Lang

owendelong commented 3 months ago

On Mar 21, 2024, at 14:03, Ryan Hamel @.***> wrote:

Owen isn't the only Juniper netadmin. My paid job is network engineering (and automation). Do I fully understand the convention center patching? No, however, I got better at handling the catwalk.

Anyway, below are a few ideas off the top of my head:

Add jumpboxes to the VM list to access various things. That way, we do not have to be on specific VLANs or need RPis setup in the NOC. Everything is an SSH session away (including various port forwards).

Since we don’t really block SSH anywhere, I’m not sure what jump boxes would buy us. The only VLANs that are restricted in any meaningful way are the vendor VLANs and we should never be on one of those except for testing the vendor network experience. (which means we shouldn’t have access to stuff, including a jump box).

Could we also virtualize massflash to remove the laptop as a dependency? It requires a VLAN allocation, and the massflash switch would uplink to the NOC switch or whatever, instead of the laptop.

There are some problems with this. The VLAN it requires has to be the same VLID as the Infrastructure VLAN for one of the buildings, so if we uplinked it to the NOC switch, chaos would ensue, cats and dogs getting along, that sort of thing.

Could we do it with enough effort, yes, probably. Is it worth that effort and the inherent risks when it goes horribly wrong? Not in my estimation.

Eventually, we can likely build a Pi image to replace the laptop, which should greatly simplify the process (burn SD card, stand up Pi, done).

Owen

owendelong commented 3 months ago

Once Rob and I get the Dev Server on line, we might be able to do some form of GRE based tunneling of SCaLE VLANs to work parties from my colo. This is probably worth further investigation. I’ll try to get with Rob and possibly Ryan and discuss possible solutions.

Owen

On Mar 21, 2024, at 15:02, David Lang @.***> wrote:

On Thu, 21 Mar 2024, Robert James Hernandez wrote:

Could we also virtualize massflash to remove the laptop as a dependency? It requires a VLAN allocation, and the massflash switch would uplink to the NOC switch or whatever, instead of the laptop.

The massflash is a livecd, its can run on any x86 machine. The reason its this way is so we dont have to have the hypervisors for a work party. Ive considered the idea of included similar massflash configuration in the core machine but there needs to be more considerations before its implemented.

I would love to have massflash as a pi image as well.

given our experience this year of various things not working through dhcp relays, etc. I would really like us to be able to bring up a virual replica of the show at the work parties, including the hypervisors, routers, and layers of switches.

Being able to bring this up outside of work parties would be even better, but at least at our final work party, we should be able to try everything we are depending on for the show.

David Lang — Reply to this email directly, view it on GitHub https://github.com/socallinuxexpo/scale-network/issues/723#issuecomment-2013901558, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAK6GTW4AWH5NCMIHKF6PZDYZNKGFAVCNFSM6AAAAABEYMLHE2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJTHEYDCNJVHA. You are receiving this because you commented.