search

dharmab / skyeye

AI Powered GCI Bot for DCS
MIT License
45 stars 11 forks source link

Skyeye Container crashes on startup on Sandy Bridge CPU #262

Closed Rabbit994 closed 2 months ago

Rabbit994 commented 2 months ago

Describe the bug

Container crashes on the startup in Kubernetes cluster with no GPU.

Steps to Reproduce

Start up the container ghcr.io/dharmab/skyeye:latest with following ENV Variables:

SKYEYE_WHISPER_MODEL=/model/ggml-small.en.bin SKYEYE_TELEMETRY_ADDRESS= SKYEYE_SRS_SERVER_ADDRESS= SKYEYE_SRS_EAM_PASSWORD=blue SKYEYE_SRS_FREQUENCIES=130.0AM,271.5AM SKYEYE_CALLSIGN=FOCUS SKYEYE_COALITION=blue SKYEYE_VOICE=feminine SKYEYE_AUTO_PICTURE=false SKYEYE_AUTO_PICTURE_INTERVAL SKYEYE_THREAT_MONITORING=true SKYEYE_THREAT_MONITORING_INTERVAL=3m SKYEYE_MANDATORY_THREAT_RADIUS=25 SKYEYE_LOG_LEVEL=info SKYEYE_LOG_FORMAT=pretty

Logs

skyeye-deploy-5df5d76d5f-vbn7c_skyeye_2024-09-04T17-32-31.txt

Platform Info

What does ./skyeye.exe --version / ./skyeye --version output?

skyeye version devel (Captured from the pod)

What OS are you running SkyEye on?

Kubernetes node Host is Ubuntu 22.04 LTS

What CPU does the hardware have? How much RAM?

Host has 16 Cores, older Xeon processor. Kubernetes restricts the container 7 cores. It's RAM limited to 12Gi but removing limits doesn't change anything. (https://www.intel.com/content/www/us/en/products/sku/64596/intel-xeon-processor-e52690-20m-cache-2-90-ghz-8-00-gts-intel-qpi/specifications.html)

Are you running any other software besides SkyEye on this machine?

Yea, there is other containers running, nothing CPU/RAM intensive.

dharmab commented 2 months ago

Hi @Rabbit994! Thanks for trying SkyEye.

First off- the container image is marked as experimental. I tore down my in-home Kubernetes cluster and repurposed it as a Jellyfin server a while back, so I don't have a good k8s test environment for the container and can't guarantee it works for any given build. So you might have to do some troubleshooting legwork 😅

From the logs it looks like something in whisper.cpp is crashing, I don't know what though. 🤔

I'll hope over to a Linux machine and see if I can reproduce the problem.

dharmab commented 2 months ago

I figured it out.

Your CPU is very, very old and lacks support for AVX2. AVX2 is required by whisper.cpp.

I have a backlog ticket to add support for cloud-based speech recognition (#162), but it will be weeks or months until I get around to it, as I am focusing on stability/performance/quality issues before new features. In the meantime, I will update the admin guide with a note about this requirement. Sorry for the inconvenience, and thank you for spending the time to collect the logs and open the issue!

In the meantime, you can try SkyEye using a Hetzner CCX23 instance for about 0.05 Euro an hour (or around 1 Euro a day if you want a 24/7 instance).

Rabbit994 commented 2 months ago

Thanks for the update. I've got older i7-7700k I was going to turn into cluster as well. I'll try and report back.