Missing linux headers on debian dataproc instances after update

[SurajAralihalli]

Error: E: Unable to locate package linux-headers-5.10.0-24-cloud-amd64

Steps to reproduce:

1. Create a dataproc instance with Debian image (2.0 or 2.1)
2. Run apt-get update
3. Run apt-get install -y -q linux-headers-$(uname -r) which is install -y -q linux-headers-5.10.0-24-cloud-amd64

Note: This error is not observed if linux-headers-5.10.0-24-cloud-amd64 is installed before running apt-get update

[viadea]

@jayadeep-jayaraman can you take a look at this one?thx

@nvliyuan FYI

[nvliyuan]

I could reproduce same issue:

[functicons]

It seems that linux-headers-5.10.0-24-cloud-amd64 was removed from the apt repo. You might need to specify 5.10.0-25-cloud-amd64 explicitly as a workaround. Is this issue related to any init actions?

[SurajAralihalli]

Yes, this is part of init actions for starting a debian instance with spark rapids plugin.

You might need to specify 5.10.0-24-cloud-amd64 explicitly as a workaround Can we fetch this dependency from some other source?

cc: @nvliyuan @viadea

[viadea]

@functicons @jayadeep-jayaraman Is this issue fixed already?

Will we have a permanent fix instead of a workaround?

[SurajAralihalli]

Closing it as the linux-headers-5.10.0-24-cloud-amd64 linux headers are now available on Debian dataproc instances. This unblocks setting up the spark rapids plugin using init script.