Closed xxxxsk closed 3 years ago
I don't think dask-yarn can submit both a dependent file and the script to run. I'd recommend bundling all of scripts into one file. Alternatively, you could install the library in an environment to be bundled with the application: https://yarn.dask.org/en/latest/environments.html#managing-python-environments
I upload my files to hdfs and it works
When I was deploying my project, I can't import func from my *.py, and there is a FileNotFoundError after client.upload_file('')
The directory structure dask_test
test.py:
I want to konw how to correctly upload file and import ?
Environment: