Remove unneeded tsinfer build lines

[benjeffery]

Closes #76 which I think was out of date, but there is some tsinfer cruft to clean up anyway.