nchammas / flintrock

A command-line tool for launching Apache Spark clusters.
Apache License 2.0
636 stars 116 forks source link

Make standalone builds deterministic #248

Closed Perados closed 4 years ago

Perados commented 6 years ago

If you are reporting a potential bug, include as many of the following as are relevant (and delete this sentence, of course):

Dependencies for standalone builds should be deterministic, because the build is completely isolated from any other installed python package. Pipenv or poetry could be a good solution to this problem.

Also, the build environment (Docker?) should be generalized and documented.