dotmesh-io / dotmesh

dotmesh (dm) is like git for your data volumes (databases, files etc) in Docker and Kubernetes
https://dotmesh.com
Apache License 2.0
539 stars 29 forks source link

Frequent errors when first starting Jupyter #788

Closed alaric-dotmesh closed 4 years ago

alaric-dotmesh commented 4 years ago

https://dotscience.slack.com/archives/C7PHSRL82/p1578674668057000

@lukemarsden reports:

I get this error fairly often when starting jupyter on a runner (when the runner didn’t yet have the project dot). always resolves when running again but it’s a bad look. is there some asynchrony in dotmesh knowing its commits after an initial pull/clone?

image

in this case it’s the machine under my desk in Bristol, which is quite fast bare-metal machine in case that makes a difference

itamarst commented 4 years ago

Digging through the code, I eventually found InitFilesystemMachine in dotmesh, which does the following:

        go s.filesystems[filesystemId].Run() // concurrently run state machine

        return s.filesystems[filesystemId], false

This suggests filesystem creation happens in background, if I'm interpreting code correctly...