stop using Ptr{Void} as a field

[mweastwood]

This doesn't play nicely with Julia's gc

Ref: https://discourse.julialang.org/t/solved-debugging-an-apparent-memory-leak/1828/2?u=michael_eastwood