fleetdm / fleet

Open-source platform for IT, security, and infrastructure teams. (Linux, macOS, Chrome, Windows, cloud, data center)
https://fleetdm.com
Other
3.02k stars 419 forks source link

Support fleetctl for linux arm64 so that you can build fleetd packages on linux arm64 #18532

Closed nonpunctual closed 5 months ago

nonpunctual commented 5 months ago

Fleet version: <!-- Copy this from the "My account" page in the Fleet UI, or run fleetctl --version --> 4.49.0 Web browser and operating system: macOS 14.4.1 Apple M2 Pro - Apple Silicon arm64


💥  Actual behavior

I would like to be able to run Ubuntu vms in tart on my Fleet production Mac & enroll them as hosts in Fleet for testing. Apparently, I can't.

🧑‍💻  Steps to reproduce

I installed npm & installed fleetctl & got the following:

screenshot_2024-04-24_at_8 39 30___pm_720

I rebuilt the vm & I downloaded the fleetctl binary from the github page. Same result.

screenshot_2024-04-24_at_8 56 25___pm_720

🕯️ More info (optional)

@edwardsb believes what I am seeing is the result of the fleetctl binary not being complied for arm64. I realize that makes this potentially a FR & not a bug, but, it is a bug if our customers are attempting to use linux vms on Apple SIlicon Macs & we don't warn them that this is not possible. This could be closed if the issue linked below (which I was helpfully reminded of by Roberto) was resolved.

https://en.wikipedia.org/wiki/Apple_silicon

The first Macs built with the Apple M1 chip were unveiled on November 10, 2020. As of June 2023, the entire Mac lineup uses Apple silicon chips.

Please compile the fleetctl binary & the fleet binary for arm64 & make them available through normal distribution. Thanks.

nonpunctual commented 5 months ago

Addendum:

Apparently, even with Parallels running an x86 emulation Ubuntu vm (i.e., in Parallels there is an option for running a vm in Docker that is supposed to use Rosetta) the fleetctl binary is failing some architecture check & will not run in a vm hosted on Apple Silicon. This in my opinion is an actual bug unless I don't understand what's happening.

Screenshot 2024-04-24 at 11 06 22 PM

None of this makes much sense. Maybe the x86 emulation only is a thing in the Ubuntu Desktop env.

Screenshot 2024-04-24 at 11 12 25 PM Screenshot 2024-04-24 at 11 12 33 PM
lucasmrod commented 5 months ago

Hi folks! My 2cents:

There seems to be two separate requests here: (1) Support fleetctl for linux arm64 so that you can build fleetd packages on linux arm64. (2) Fleet to offer fleetd components (orbit and Fleet Desktop) for linux arm64 in its TUF (and leverage the existing osquery for linux arm64 in https://osquery.io/downloads/official/5.12.1). When you execute fleetctl package it downloads fleetd components from Fleet's TUF server (and it currently doesn't host linux arm64 executables).

Maybe this issue can be converted to fix request (1). And #1845 exists for request (2).

lukeheath commented 5 months ago

@nonpunctual I don't think this is a bug unless, unless we claim to support tart and don't. If not, please re-spec as feature request (or could be engineering-initiated if it's purely for local testing).

nonpunctual commented 5 months ago

@lukeheath I agree with you about the original report & I can separate these issues, but, in my comment I hope it's clear that my Ubuntu vm is an x86 emulation using Rosetta. To me, that means that fleetctl should open on that VM.

It is fairly common even on native macOS is that architecture checks using binaries like arch see aarch64 somewhere & then ignore the fact that x86 emulation is being used. That seems like a bug to me.

lukeheath commented 5 months ago

@nonpunctual Yes, please separate the feature request part from the bug. Is this the request?

Please compile the fleetctl binary & the fleet binary for arm64 & make them available through normal distribution.

As for the bug:

I realize that makes this potentially an FR & not a bug, but it is a bug if our customers are attemptininux vms on Apple SIlicon Macs & we don't warn them that this is not possible.

Are any customers trying to use Linux VMs on Apple Silicon Macs? We don't consider VMs running on different hardware as part of our compatibility. For that reason, I suggest this bug be closed and a single feature request is opened. If I need clarification on something and there is a bug in how Fleet is documented to work, please revise and let me know. Thanks!

nonpunctual commented 5 months ago

Hi @lukeheath

Thanks, I have converted this to a FR. I will make a separate bug report for the x86 emulation problem.

I am a little baffled by the idea that we would not support this. This is, as I see it, another example of "dogfood" perhaps causing internal biases to prevent us from seeing the outside world as it is.

lukeheath commented 5 months ago

@nonpunctual It's not so much a question of do we want to support this, but do we claim to support it? If so, then not supporting it is a bug. If not, then supporting it is a feature request.

noahtalerman commented 5 months ago

@nonpunctual heads up, I updated the title of this feature request to the following: Support fleetctl for linux arm64 so that you can build fleetd packages on linux arm64

Let me know if that's not right.

nonpunctual commented 5 months ago

It was originally a bug report so totally fine.

noahtalerman commented 5 months ago

Closed because it's a duplicate of this issue:

fleet-release commented 5 months ago

Fleetctl on arm64, Security tests in the clouds, Harmony restored.

nonpunctual commented 5 months ago

Are any customers trying to use Linux VMs on Apple Silicon Macs?

@noahtalerman @lukeheath

https://github.com/fleetdm/fleet/issues/1845#issuecomment-2106039735