Be more careful when converting values

[jordemort]

Shoring up some corner cases that were causing segfaults on my way to implementing https://github.com/caketop/python-starlark-go/issues/143