some type stability enhancements

[alecloudenback]

This makes the Julia version ~15% faster than before by avoiding Any and providing some hints to the return types (theory: memoization/recursion made the types hard to infer?)

[MatthewCaseres]

Thanks!