search

dataform-co / dataform-web-tracking

Dataform is a collaborative data modelling platform that enables analysts and engineers to manage complex data models in SQL
https://dataform.co
MIT License
2 stars 0 forks source link

Transient schedule failures due to missing temporarily file #153

Closed lewish closed 5 years ago

lewish commented 5 years ago 
 Unable to compile project: ENOENT: no such file or directory, open '/tmp/dataform/...'

This is transient, I believe it's mostly likely due to two project compilations kicking off at exactly the same time. We can re-evaluate how we pass back compilation results here, or implement a global lock on project + branch.

BenBirt commented 5 years ago

I propose instead writing to a randomly generated directory in /tmp (and then deleting that directory post-compilation), that way we can be lockless.