search

Cloud-CV / visual-chatbot

:cloud: :eyes: :speech_balloon: Visual Chatbot
http://visualchatbot.cloudcv.org
188 stars 58 forks source link

Issue while setting up visual-chatbot #6

Closed Ram81 closed 6 years ago

Ram81 commented 6 years ago

@deshraj I have completed the installation steps but when I launch the three commands to start with interface I am getting these errors can you help me resolve them ? abc

Ram81 commented 6 years ago

@deshraj I have resolved previous issue in python worker.py data folder was missing in my installation but I am getting out of memory error now, I am running the setup on 940M GeForce GPU of 2GB is there a requirement of higher configuration ? abc

Ram81 commented 6 years ago

@deshraj I resolved the issue of worker.py and worker_captioning.py, but I am unable to load weights in my local system what is the minimum requirements needed for running visual-chatbot and also the issue for django server still remains I am unable to launch django server if you can suggest how to resolve it, that would be of great help

deshraj commented 6 years ago

@Ram81 it looks like the GPU that you are using has really low memory compared to what is required. Loading the captioning model takes around ~1.6 GB and the Visual Dialog Dialog model takes ~1.3GB which is more than what you have.

I would recommend you should try running it on CPU.

Ram81 commented 6 years ago

@deshraj I will convert the weights and try it on cpu, other than that why am I unable to launch Django channels server in my browser I tried launching a simple Django project it works but the channels server is not working.

There's no proxy setup too, can you help with that?

deshraj commented 6 years ago

I think you should also look at the main Visual Dialog repository (https://github.com/batra-mlp-lab/visdial) where we have provided the code for training and evaluating the visual dialog models (one of the models is integrated here in the chatbot and the codebase of visual-chatbot is built on top of that). I hope that might help.

I can see that you are having problem in running the command python worker_captioning.py/. It looks like you dont have the CPU checkpoint (available here: http://cs.stanford.edu/people/karpathy/neuraltalk2/checkpoint_v1_cpu.zip). Also, you will have to change the path to the captioning model after you download it (here https://github.com/Cloud-CV/visual-chatbot/blob/master/chat/constants.py#L44)

Please feel free to contribute back to this repository so that we are able to help others and they don't face similar issues that you are facing. :)

Ram81 commented 6 years ago

@deshraj I already corrected those issues with worker_captioning.py by obtaining proper checkpoints, the only issue I am facing currently is when I run python manage.py runserver there is no error but when I try to access localhost from browser I am unable to connect to django server.

worker.py and worker_captioning.py is working fine as of now. Can you help me resolve the django server issue, I searched through some links the issue seems to be because of proxy but I haven't configured any proxy in my system that's why I don't understand why I am unable to launch django server.

deshraj commented 6 years ago

This is really weird. I am not sure what is going on here. You might want to upgrade both django and django-channels version and see if that works. Otherwise check if you are using the versions mentioned in the requirements file.

Ram81 commented 6 years ago

@deshraj while evaluating the model from https://github.com/batra-mlp-lab/visdial I am getting this error can you help abc

Ram81 commented 6 years ago

abc @deshraj can you help me with this, I have completed setup but after uploading image when i try to ask a question worker.py fails

deshraj commented 6 years ago

@Ram81 can you please create a pastebin link with the full error log? I would like to see the full error log before suggesting any solution.

deshraj commented 6 years ago

@deshraj while evaluating the model from https://github.com/batra-mlp-lab/visdial I am getting this error can you help

For this error, please open an issue on https://github.com/batra-mlp-lab/visdial @abhshkdz is maintaining that repository, so he will be able to help you in a better way with this error.

abhshkdz commented 6 years ago

Torch/rnn vs. Element-research/rnn version issue, follow steps mentioned here: https://github.com/batra-mlp-lab/visdial/issues/14#issuecomment-339412884.

On Thu, Mar 15, 2018 at 11:24 PM, Deshraj Yadav notifications@github.com wrote:

@deshraj https://github.com/deshraj while evaluating the model from https://github.com/batra-mlp-lab/visdial I am getting this error can you help

For this error, please open an issue on https://github.com/batra-mlp- lab/visdial @abhshkdz https://github.com/abhshkdz is maintaining that repository, so he will be able to help you in a better way with this error.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Cloud-CV/visual-chatbot/issues/6#issuecomment-373615263, or mute the thread https://github.com/notifications/unsubscribe-auth/ABGlibam8wb4C-ZBnbLTHx-nipdiXm-vks5te1qLgaJpZM4SYRW0 .

-- Abhishek Das

Ram81 commented 6 years ago

Thanks @abhshkdz @deshraj I was successfully able to setup visual-chatbot