search

SimpleDataLabsInc / prophecy-build-tool

Prophecy-built-tool (PBT) allows you to quickly build projects generated by Prophecy (your standard Spark Scala and PySpark pipelines) to integrate them with your own CI / CD (e.g. Github Actions), build system (e.g. Jenkins), and orchestration (e.g. Databricks Workflows).
https://pypi.org/project/prophecy-build-tool
Apache License 2.0
28 stars 3 forks source link

dependencies are not gathered for test-v2 #96

Open neontty opened 2 months ago

neontty commented 2 months ago

when running test-v2 function we should gather the prophecy-libs (python and maven) the same way the v1 function does.

Now we even have the benefit of pbt_project.yml where they are defined for the entire project

neontty commented 2 months ago

see

def get_python_dependencies(self, path_pipeline_absolute, path_pipeline):