search

aws / sagemaker-spark-container

The SageMaker Spark Container is a Docker image used to run data processing workloads with the Spark framework on Amazon SageMaker.
Apache License 2.0
36 stars 74 forks source link

Error in init #64

Open RajarshiBhadra opened 3 years ago

RajarshiBhadra commented 3 years ago

When I am running make build I am getting the following error

cp {Pipfile,Pipfile.lock,setup.py} ./spark/processing/3.0/py3
cp: cannot stat '{Pipfile,Pipfile.lock,setup.py}': No such file or directory
make: *** [Makefile:38: init] Error 1

Any idea what I might be doing wrong?

psantacl commented 2 years ago

We have encountered the same exact problem. Funnily enough, if you directly run 'cp {Pipfile,Pipfile.lock,setup.py} ./spark/processing/3.0/py3' in bash it executes just fine. Can someone please advise?

psantacl commented 2 years ago

It appears to an issue with the shell expansion within the Makefile. We were able to solve it with the following:

        #cp {Pipfile,Pipfile.lock,setup.py} ${BUILD_CONTEXT}
        cp Pipfile ${BUILD_CONTEXT}
        cp Pipfile.lock ${BUILD_CONTEXT}
        cp setup.py ${BUILD_CONTEXT}
RajarshiBhadra commented 2 years ago

Yes. This was our problem as well. There were some other incompatibilities that we had to overcome on ubuntu 20.0 to make it work. Let me know if you need any help!