Add CI check for builds with only default features on

[Max-Meldrum]

Currently, the CI runs everything with all-features which means it may not catch errors of when compilation happens with default features.