search

KBVE / kbve

11 stars 13 forks source link

[Concept] : [Backend] : Charles. #96

Open h0lybyte opened 8 months ago

h0lybyte commented 8 months ago

Core Concept/Theory A clear and concise description of what the concept is. Ex. It would be cool if [...]

Charles is a mini-super-computer that is currently in the development phase.

Official Charles Docs

Specs:

Internal:

Alternative Ideas Is there any other way this concept could be used?

We can start to build out a small-scale mL Ops project, the main focus would be to get the software to be operational via automation.

Alternative Examples/Sources Are there any other references that you can provide?

No alternative examples as of right now!

Additional information

Add any other context or examples of this concept here.

h0lybyte commented 8 months ago

Operating System ISO: https://proxmox.com/en/downloads/proxmox-virtual-environment/iso/proxmox-ve-8-0-iso-installer

I am currently operating at 7.x series but preparing to migrate over to the 8.x series, just need to make sure the backups work as planned.

The nvdia pass-through would be done at the hardware level.

Proxmox -> 
                    QMEU -> 
                                    [Docker -> Github Runner]

The other option would be to just run Ubuntu and Docker, with the Github Runner as an image inside of the Docker.

I am actually thinking of doing both and then packaging them up as two different simplified operating systems.

h0lybyte commented 7 months ago

The QEMU deployment will be via Proxmox but the [Docker -> Github Runner] will be actually closer to this structure:

[Portainer -> Docker -> Github Runner] , we will be using Portainer as a medium / proxy. As for the Charles, it will be in the edge group within the portainer eco-system, however with 2.19, there were some breaking changes to the Portainer API. I am currently rebuilding the actions to be compatible with the new version.

h0lybyte commented 6 months ago

Switching this over to the backlog for another week, still need to fix up the front end and make sure everything is functional before coming back to Charles.

h0lybyte commented 5 months ago

Another issue that we have with Charles is the amount of energy that it is pulling, which I am going to take a look at tomorrow and see if I could do a bit better with the wiring. I also am thinking of splitting it into a set of 3? Kinda like a mini-HA setup, that could be something of interest down the line as well.

lancilloties commented 4 months ago

@h0lybyte Can you update the doc https://kbve.com/project/charles/ ? I'd love to review the electronics design :)

h0lybyte commented 2 months ago

New power supply has arrived and I will start to set it up in about a hour. I will use this ticket as a reference point for how it will go.

h0lybyte commented 2 months ago

Charles is now at an operational level but not yet at a "production" level.

We still need to migrate a decent amount of the ecosystem from docker swarm to k8s, which has its own headaches and overhead.