Simplify the container

[daniel-bara]

• Remove packages that we don't need (yet) from the Dockerfile
• Move customizations to an untracked file