[ENH] Add debugger entrypoints at critical parts of the code

[mattcieslak]

This library is very difficult to debug. Adding a --debug flag that drops you into ipdb would be really nice.