No installation guidance for Hyper-V

jrose-qualys commented 1 year ago

Hello, We need some details on the best practices for installation of Flatcar Container Linux on Hyper-V.

how to gain support for VHDX disks
how to support Hyper-V Live MIgration (in the same way that open-vm-tools will allow Flarcar to support VMWare Vmotion).

Hyper-V being a Microsoft product, and Kinvolk being bought by Microsoft, you should have direct access to Hyper-V developers who can help make Flatcar on Hyper-V a seamless proposition.

Regards Joe

fsdrw08 commented 7 months ago

any updates? coreos had already support hyper-v

jepio commented 5 months ago

Just looked at this. The ignition support for Hyper-V is in alpha right now.

We need the following to make it work:

[x] docs
[x] We need to switch the generated img over to vhdx
[x] We should consider using a different compression that is more Windows friendly.
[x] We need the hv_utils module in the initramfs to get ignition to work
[x] powershell script to make it easy for people to try this out

jrose-qualys commented 5 months ago

Hi Jeremi, Regarding the HyperV support, there’s a list of things needed :

VHDX support is long overdue and we’re often asked for this by customers who want to use dynamic disks ..they cannot do this today
In testing vSCSI driver (4 channels, 8 disks per channel on SCSI ID 0-7) did not work, so our customers have been limited to vIDE and 2 disks only.
HyperV live migration support would allow a live Qualys QGS appliance running on Flatcar then HyperV hosting to be moved without any shutdown/ restart operation… similar to vmotion on VMware .

Many thanks.

Regards Joe

Sent from Outlook for iOShttps://aka.ms/o0ukef

From: Jeremi Piotrowski @.> Sent: Friday, March 22, 2024 9:44:42 AM To: flatcar/Flatcar @.> Cc: Joseph Rose @.>; Author @.> Subject: Re: [flatcar/Flatcar] No installation guidance for Hyper-V (Issue #1009)

Just looked at this. The ignition support for Hyper-V is in alpha right now.

We need the following to make it work:

docs
We need to switch the generated img over to vhdx
We should consider using a different compression that is more Windows friendly.
We need the hv_utils module in the initramfs to get ignition to work
powershell script to make it easy for people to try this out

— Reply to this email directly, view it on GitHub [github.com]https://urldefense.com/v3/__https://github.com/flatcar/Flatcar/issues/1009*issuecomment-2014717805__;Iw!!Pw1rFClp!r7hADcu4g8AX9X1VZLCKwGa3tsTF9jwggiOXvCnTD8itdgtVkL6v5FXO8sirZ_80cFjc56OoVdSqTezh7OFtGYc$, or unsubscribe [github.com]https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/A7O2DZZEKNN73WHVTVSMOHTYZP4QVAVCNFSM6AAAAAAXNUXYE2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJUG4YTOOBQGU__;!!Pw1rFClp!r7hADcu4g8AX9X1VZLCKwGa3tsTF9jwggiOXvCnTD8itdgtVkL6v5FXO8sirZ_80cFjc56OoVdSqTezhibvcCWU$. You are receiving this because you authored the thread.Message ID: @.***>

ader1990 commented 5 months ago

Hello @jrose-qualys,

Adding the VHDX support would be rather easy, as it is just a quick fix.

An important question would be if you also still need the VHD image at the same time, or we can remove it the VHD and offer just VHDX?

Thank you.

jrose-qualys commented 5 months ago

Hi Adrian, It would be useful to have both.

            Key with HyperV is being able to use VHDX and Gen2 VMs – currently this does not work.

            Customers complain about the VHD fixed disks – the time taken to format, especially with iSCSI storage, is quite long. – 20-30 mins sometimes.

Appliance with VHD fixed disks, Gen1 VMs working Appliance with VHDX dynamic disks, Gen1 VMs failed Appliance with VHDX dynamic disks, Gen2 VMs failed (no VHD option)

            My big concern is support for VHDX and Gen2 as Gen1+VHD may disappear from new releases, such as Windows Server 2025 with HyperV service, either at GA release or later, e.g. 26H1 release.

            Many thanks.

Regards Joseph Rose Technical Product Manager @ Qualys

From: Adrian Vladu @.> Date: Monday, 25 March 2024 at 13:22 To: flatcar/Flatcar @.> Cc: Joseph Rose @.>, Mention @.> Subject: Re: [flatcar/Flatcar] No installation guidance for Hyper-V (Issue #1009)

Hello @jrose-qualys [github.com]https://urldefense.com/v3/__https:/github.com/jrose-qualys__;!!Pw1rFClp!uj6gVbTet1S3WaLRmlMjowayTWF9oCnE7RA0wBAHCDPb0tVMrJ-ZdTaSmktVyr5OeSrftISSqNFDouNYO56Nbrs$,

Adding the VHDX support would be rather easy, as it is just a quick fix.

An important question would be if you also still need the VHD image at the same time, or we can remove it the VHD and offer just VHDX?

Thank you.

— Reply to this email directly, view it on GitHub [github.com]https://urldefense.com/v3/__https:/github.com/flatcar/Flatcar/issues/1009*issuecomment-2017997832__;Iw!!Pw1rFClp!uj6gVbTet1S3WaLRmlMjowayTWF9oCnE7RA0wBAHCDPb0tVMrJ-ZdTaSmktVyr5OeSrftISSqNFDouNYKdq3FkA$, or unsubscribe [github.com]https://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A7O2DZZCVNV74U4QJZXNCT3Y2AQIBAVCNFSM6AAAAAAXNUXYE2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJXHE4TOOBTGI__;!!Pw1rFClp!uj6gVbTet1S3WaLRmlMjowayTWF9oCnE7RA0wBAHCDPb0tVMrJ-ZdTaSmktVyr5OeSrftISSqNFDouNYCS2NMo4$. You are receiving this because you were mentioned.Message ID: @.***>

ader1990 commented 5 months ago

Just looked at this. The ignition support for Hyper-V is in alpha right now.

We need the following to make it work:

[ ] docs

[ ] We need to switch the generated img over to vhdx

[ ] We should consider using a different compression that is more Windows friendly.

[ ] We need the hv_utils module in the initramfs to get ignition to work

[ ] powershell script to make it easy for people to try this out

We need the hv_utils module in the initramfs to get ignition to work - implemented by https://github.com/flatcar/bootengine/pull/92 We need to switch the generated img over to vhdx - work in progress by https://github.com/flatcar/scripts/pull/1791

ader1990 commented 5 months ago

Hello @jrose-qualys,

You can find a .vhdx image built here: https://bincache.flatcar-linux.net/images/amd64/9999.9.9+ader1990-hyperv-vhdx-support/, using the PR code from https://github.com/flatcar/scripts/pull/1791.

Image direct download link: https://bincache.flatcar-linux.net/images/amd64/9999.9.9+ader1990-hyperv-vhdx-support/flatcar_production_hyperv_vhdx_image.vhdx.bz2.

Please let us know if the image works in your environment. Currently, the image is not secure boot signed and it needs Secure Boot to be disabled when used with a Gen2 Hyper-V VM.

Thank you.

ader1990 commented 5 months ago

Just looked at this. The ignition support for Hyper-V is in alpha right now.

We need the following to make it work:

[ ] docs

[x] We need to switch the generated img over to vhdx

[ ] We should consider using a different compression that is more Windows friendly.

[x] We need the hv_utils module in the initramfs to get ignition to work

[ ] powershell script to make it easy for people to try this out

VHDX support is merged, as well as the introduction of the hv_utils module in initrd. https://github.com/flatcar/scripts/pull/1791 https://github.com/flatcar/bootengine/pull/92

Docs will include the powershell script to try out Flatcar on Hyper-V: https://github.com/flatcar/flatcar-website/pull/315

jrose-qualys commented 5 months ago

Hi, It’s good to see HyperV receiving some attention.

            As part of the move to VHDX, can we also ensure:

Live migration support is there, just as you do for openvm-tools and libvirtd on KVM ?
vSCSI disk support provides 4 channels of 8 devices, which is much more scalable than vIDE, which is all that has so far worked , in the testing that Qualys has done, internally and with customers

Since HyperV is Microsoft’s hypervisor, the support needs to be on par with VMWare 😊

Regards Joseph Rose Technical Product Manager @ Qualys

From: Adrian Vladu @.> Date: Tuesday, 9 April 2024 at 15:32 To: flatcar/Flatcar @.> Cc: Joseph Rose @.>, Mention @.> Subject: Re: [flatcar/Flatcar] No installation guidance for Hyper-V (Issue #1009)

Just looked at this. The ignition support for Hyper-V is in alpha right now.

We need the following to make it work:

docs
We need to switch the generated img over to vhdx
We should consider using a different compression that is more Windows friendly.
We need the hv_utils module in the initramfs to get ignition to work
powershell script to make it easy for people to try this out

VHDX support is merged, as well as the introduction of the hvutils module in initrd. flatcar/scripts#1791 [github.com]<https://urldefense.com/v3/__https:/github.com/flatcar/scripts/pull/1791__;!!Pw1rFClp!rxAL7qocZIKWYhguVvISJachKL0MkMrxKpjeQW5aD5VAF93iApyZJRtL-zfPfbTvLvAf8ARILMlTR1X1J05UU$> flatcar/bootengine#92 [github.com]<https://urldefense.com/v3/__https:/github.com/flatcar/bootengine/pull/92__;!!Pw1rFClp!rxAL7qocZIKWYhguVvISJachKL0MkMrxKpjeQW5aD5VAF93iApyZJRtL-zfPfbTvLvAf8ARILMlTR1Xm53bfzY$>

Docs will include the powershell script to try out Flatcar on Hyper-V: flatcar/flatcar-website#315 [github.com]https://urldefense.com/v3/__https:/github.com/flatcar/flatcar-website/pull/315__;!!Pw1rFClp!rxAL7qocZIKWYhguVvISJachKL0MkMrxKpjeQW5aD5VAF93iApyZJRtL_-zfPfbTvLvAf8ARILMlTR1XqCHPGWg$

— Reply to this email directly, view it on GitHub [github.com]https://urldefense.com/v3/__https:/github.com/flatcar/Flatcar/issues/1009*issuecomment-2045333730__;Iw!!Pw1rFClp!rxAL7qocZIKWYhguVvISJachKL0MkMrxKpjeQW5aD5VAF93iApyZJRtL_-zfPfbTvLvAf8ARILMlTR1XXlrj6zY$, or unsubscribe [github.com]https://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A7O2DZ6Q46DEM3XBB6QB4Z3Y4P3YTAVCNFSM6AAAAAAXNUXYE2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBVGMZTGNZTGA__;!!Pw1rFClp!rxAL7qocZIKWYhguVvISJachKL0MkMrxKpjeQW5aD5VAF93iApyZJRtL_-zfPfbTvLvAf8ARILMlTR1XYTZo0rc$. You are receiving this because you were mentioned.Message ID: @.***>

flatcar / Flatcar

No installation guidance for Hyper-V #1009