Closed AshwinAce closed 5 years ago
What is the output of pip freeze | grep luminoth
?
How did you install Luminoth?
Can you show the logs of the lumi gc cloud
?
luminoth==0.2.3.dev0
I installed by cloning the git repostory and running setup.py install
Here is a link to the logs:
setup.py
file that you had manually copied before, in your attempt to make the command work. According to issue #231, I guess this file is /home/ace/anaconda3/lib/python3.6/site-packages/setup.py
. The presence of this file makes lumi gc cloud
think that you are using editable mode (used only for development).pip uninstall luminoth
. Verify that lumi
errors (command should not be found).pip install luminoth
You shouldn't need to copy any file whatsoever to make cloud work. Let me know.
/home/ace/anaconda3/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
from ._conv import register_converters as _register_converters
Bucket name not specified. Using "luminoth-107908267694143463013".
Generating "/tmp/tmp1_nm4rou/setup.py" for installing luminoth==0.2.2.
Traceback (most recent call last):
File "/home/ace/anaconda3/bin/lumi", line 11, in <module>
sys.exit(cli())
File "/home/ace/anaconda3/lib/python3.6/site-packages/click/core.py", line 722, in __call__
return self.main(*args, **kwargs)
File "/home/ace/anaconda3/lib/python3.6/site-packages/click/core.py", line 697, in main
rv = self.invoke(ctx)
File "/home/ace/anaconda3/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/home/ace/anaconda3/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/home/ace/anaconda3/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/home/ace/anaconda3/lib/python3.6/site-packages/click/core.py", line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/home/ace/anaconda3/lib/python3.6/site-packages/click/core.py", line 535, in invoke
return callback(*args, **kwargs)
File "/home/ace/anaconda3/lib/python3.6/site-packages/luminoth/tools/cloud/gcloud.py", line 87, in decorated_function
return f(*args, **kwargs)
File "/home/ace/anaconda3/lib/python3.6/site-packages/luminoth/tools/cloud/gcloud.py", line 271, in train
package_path = build_package(bucket, base_path)
File "/home/ace/anaconda3/lib/python3.6/site-packages/luminoth/tools/cloud/gcloud.py", line 130, in build_package
tarball_filename = os.listdir(output_dir)[0]
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmp1_nm4rou/output'
is the error that happens when I try to run. That was fixed by moving setup.py and README.md to a folder previously. I did get luminoth 0.2.2 installed as opposed to the dev version I had previously.
You should NOT move setup.py to that folder previously. Please delete those files (this is what I am saying in my previous comment).
As of your output, this is the line I cared the most about:
Generating "/tmp/tmp1_nm4rou/setup.py" for installing luminoth==0.2.2.
It means we are generating a stub for installing into Google Cloud. For some reason, the packaging looks to be failing.
Open the /home/ace/anaconda3/lib/python3.6/site-packages/luminoth/tools/cloud/gcloud.py
file with a text editor, scroll to this block
devnull = open(os.devnull, 'w')
subprocess.call(
['python', 'setup.py', 'sdist', '--dist-dir', output_dir],
cwd=package_path, stdout=devnull, stderr=devnull,
)
And replace it with:
devnull = open(os.devnull, 'w')
subprocess.call(
['python', 'setup.py', 'sdist', '--dist-dir', output_dir],
cwd=package_path
)
Then try again, and show me the output of the command. Hopefully, with this we can debug why it fails for you :)
When I said previously, I meant the previous times when I had this problem with other versions of luminoth. I did not move any files when I ran here. Sorry for the usage of ambiguous wording. I did the change you mentioned, here are the results.
Bucket name not specified. Using "luminoth-107908267694143463013".
Generating "/tmp/tmpp1nf2qcy/setup.py" for installing luminoth==0.2.2.
python: can't open file 'setup.py': [Errno 2] No such file or directory
Traceback (most recent call last):
File "/home/ace/anaconda3/bin/lumi", line 11, in
Bucket name not specified. Using "luminoth-107908267694143463013".
Generating "/tmp/tmpp1nf2qcy/setup.py" for installing luminoth==0.2.2.
python: can't open file 'setup.py': [Errno 2] No such file or directory
Traceback (most recent call last):
File "/home/ace/anaconda3/bin/lumi", line 11, in
Thanks for your help debugging this! It was all because of a misnamed variable in the cwd=
argument. Should be fixed now.
You can install from the cloned repo with pip install .[gcloud]
and let me know!
PD: Please use the code blocks since it makes multiline strings much more readable (and saves me from editing your issues :D).
I cloned the repo and ran that command. This error vanished and the job is preparing currently. I will use code blocks in the future. I will report back in a few minutes.
Error logs when run on the cloud:
After this the logs indicated that a cleanup was finished followed by this error:
As far as I can see, this is the same error as before, I am posting in case I have missed something. Before running, I had to move setup.py and README.md to a particular folder to avoid errors as I did in a previous error report. You had asked me to install version 0.2.2. However, this was the version that was eventually installed. I'm not sure to what extent that influenced these results.