microsoft / ebpf-for-windows

eBPF implementation that runs on top of Windows
MIT License
2.87k stars 224 forks source link

Ideally the downlevel tests would be a matrix of supported versions. #3424

Open shankarseal opened 6 months ago

shankarseal commented 6 months ago
          Ideally the downlevel tests would be a matrix of supported versions.

_Originally posted by @mtfriesen in https://github.com/microsoft/ebpf-for-windows/pull/3421#discussion_r1550048019_

saxena-anurag commented 5 months ago

Since the selfhosted runners are limited, should we instead use github runners to run kernel regression / downlevel tests? The only drawback will be that we will not get kernel dumps though, but will allow us to scale.

saxena-anurag commented 5 months ago

Along with the matrix of down-level versions, we can also add permutations of tests for each version:

  1. both extensions and native modules from older version -- tested in selfhosted runners.
  2. only extensions from older version -- tested in GitHub runner.
  3. only native modules from older version -- tested in GitHub runner.
shankarseal commented 2 months ago

@saxena-anurag - please make these regression tests part of the scheduled tasks, instead or running on each PR to save resources.