Removes pr's against main and test from CI triggers

[sakari-malkki]

This should fix the issue where CI and CD are unnecessarily ran when there's a PR against test or main