Remove ffi! macro, refactor a bunch of internals, no breaking changes

[ldesgoui]

All unsafe blocks are not a lot more auditable even though they are still plenty, I am very proud of this change