Separate lib package into separate mod when things stabilize

[fnuecke]

Easier to test and fix stuff for now, but at some point separate it out so I can use it in other projects.