Cleanup various deletions

[Profpatsch]

This is a bunch of cleanup tasks I did while trying to improve the build loop.

cc @sternenseemann

Checklist

• [ ] Updated the documentation (code documentation, command help, ...)
• [ ] Tested the change (unit or integration tests)
• [ ] Amended the changelog in release.nix (see release.nix for instructions)