Update ci configuration - caching, main branch ci, and diff on pre-commit failures

[acmiyaguchi]

So it turns out that installing packages from the cache isn't all that much faster from installing from scratch. I think this is because we're not saving the site-packages, but instead just storing the wheels. If we were using pipenv or poetry, this might be different.