*Actually* skip tests while running backwards compatibility test.

[nakulj]

Issue #, if available:

The Maven compiler plugin does not respect the -Dskiptests flag. As another benefit, this change skips recompiling the test sources too.

Of course ideally it would be nice to just get the classes from the previous build step but i have no idea how to do this.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.