cubed-dev / cubed-benchmarks

Automated benchmark suite for testing the performance of cubed
Apache License 2.0
2 stars 0 forks source link

Different environments for different executors? #5

Closed TomNicholas closed 8 months ago

TomNicholas commented 8 months ago

Different executors have different dependencies, so we might want to run them in different CI environments.

We probably still want a single test fixture providing the runtime, but that perhaps should be parameterized at the level of different CI jobs (in a GH actions matrix).

tomwhite commented 8 months ago

We need different environments for different executors since the dependencies are so varied (and had conflicts in the past at least).

We could have environment-lithops-aws.yml, etc, and then create the runtime objects according to what can be imported. So for Lithops AWS we'd try to import lithops and import s3fs and if that succeeded add the corresponding config file.

Perhaps there's a more elegant way of doing it though.

tomwhite commented 8 months ago

Fixed in #11