Build library definitions as if user code

[prakhar1989]

Better extensibility, plus no need for typing a ton of annotations.

Need to resolve circular dependency issues. #68 is the way to go.