airavata-courses / Noodle

Advanced Distributed repo @ Weather Forecast App
1 stars 2 forks source link

[Deployment] issues in Deployment #38

Open KalaRaja opened 4 years ago

KalaRaja commented 4 years ago

Hi team,

  1. please write instructions for Ubuntu 18.04
  2. cannot start usermanagement service:

Screen Shot 2020-02-22 at 10 45 04 AM

  1. cannot start data retrieval, data modeling service even after installing Flask using pip install -U Flask Screen Shot 2020-02-22 at 10 49 34 AM

  2. I could not find any directory named dataprocessing. Screen Shot 2020-02-22 at 11 07 44 AM

  3. cannot start session management service Screen Shot 2020-02-22 at 10 53 42 AM

  4. I could not find apigateway directory Screen Shot 2020-02-22 at 11 07 44 AM

  5. Front end works.

Please fix the issues by today afternoon.

nayeembaig commented 4 years ago

Hi Shashank,

I have added the missing services to integration branch.

Since I have done the User management service, the error could be because there's no local instance of MongoDB running. I have to ask, do you have a local instance of MongoDB?

KalaRaja commented 4 years ago

Hi Shashank,

I have added the missing services to integration branch.

Since I have done the User management service, the error could be because there's no local instance of MongoDB running. I have to ask, do you have a local instance of MongoDB?

yes I do. Screen Shot 2020-02-22 at 5 08 44 PM

KalaRaja commented 4 years ago

Also. I have installed kafka on my ubuntu, However, I see no use of that, there are no instructions to start zookeeper and kafka clusters.

EDIT: I got the usermanagement running, for python services, there are several other python dependencies like flask_script, flask_migrate that are not added in the instructions, please do so.

KalaRaja commented 4 years ago

Screen Shot 2020-02-22 at 5 32 08 PM

naga-anjaneyulu commented 4 years ago

Hi, I have updated wiki with the latest set of installation instructions and configuration ranging from kafka-topics, creating databases and packages need to installed and other configuration issues.

naga-anjaneyulu commented 4 years ago

We have also pushed the latest changes regarding the blocker into the integration branch .

KalaRaja commented 4 years ago

as a suggestion, please hook your commit ids here so that i could verify the fixes.

KalaRaja commented 4 years ago

redeployment issues:

  1. No instructions for linux systems such as the popular and lts 18.04 ubuntu bionic.
  2. no version of dependencies mentioned
  3. link to ionstructions for kafka and zookeeper are for windows.
  4. how to install postgres (commands ?), what is pgAdmin (command ?) , how to create databases (command ?).
  5. How to creaste kafka topics (command ?) .
  6. No instructions for mongoDB start or stop ?
  7. Some python dependencies threw errors Screen Shot 2020-02-26 at 7 39 24 PM Screen Shot 2020-02-26 at 7 39 56 PM

rest all issues are same as above.

naga-anjaneyulu commented 4 years ago

Sure, We will work on this immediately .

naga-anjaneyulu commented 4 years ago

as a suggestion, please hook your commit ids here so that i could verify the fixes.

Sure, will do that .

naga-anjaneyulu commented 4 years ago
  1. https://github.com/airavata-courses/Noodle/commit/eec98ba9b9c686a995d03bf6db6440a40c940ecf
  1. https://github.com/airavata-courses/Noodle/commit/b4917f5df1f402d54185ba5b08e70ec438222344

  2. Revision - https://github.com/airavata-courses/Noodle/wiki/Home/3d6a00669e6a5dd9e773e10310a38d469d17e3be

These were the previous commit ids , will share the new commit ids after making the required changes.

naga-anjaneyulu commented 4 years ago

redeployment issues:

No instructions for linux systems such as the popular and lts 18.04 ubuntu bionic. no version of dependencies mentioned link to ionstructions for kafka and zookeeper are for windows. how to install postgres (commands ?), what is pgAdmin (command ?) , how to create databases (command ?). How to creaste kafka topics (command ?) . No instructions for mongoDB start or stop ? Some python dependencies threw errors

rest all issues are same as above.

  1. I have added instructions for Ubuntu in documentation now .
  2. I have mentioaned version dependencies for python, java, PostgreSQL ,kafka,zookeeper
  3. I have added latest instructions for ubuntu users too.
  4. I have added all sets of instructions for windows users as well as ubuntu users , pgadmin is primarily GUI tool for windows users ,I have also added set of instructions for creating databases .
  5. I have provided commands for creating topics also , kindly take a look at it .
  6. Python dependencies errors were primarily due to versioning ., please ensure you are using python 3.7. or above , have mentioned this also .
  7. Regarding psycopg2 , if pip install psycopg2 fails , one can try for pip install psycopg2-binary , I have tested this on Ubuntu system .It worked.I have updated the instructions accordingly.
  8. Regarding json , it was jsons , have updated the wiki about the same . Please check and let me know for further issues .
naga-anjaneyulu commented 4 years ago

Hi team,

please write instructions for Ubuntu 18.04 cannot start usermanagement service:

cannot start data retrieval, data modeling service even after installing Flask using pip install -U Flask

I could not find any directory named dataprocessing.

cannot start session management service

I could not find apigateway directory

Front end works.

Please fix the issues by today afternoon.

I have clearly stated instructions for setting up sessionmanagement service .I have tried and it worked on Ubuntu 16.04 . IMG_20200301_022236 So,Kindly recheck and let me know . Please ensure all databases, kafka , zookeeper are running before starting any service.

naga-anjaneyulu commented 4 years ago

Regarding > Flask module not found error , model.job not found error , as mentioned earlier these issues might be arising due to python versioning, ensure that you have a python version >= 3.7.0 and I have also updated latest set of instructions for running these flask microservices by creating virtual environment first and later moving the services to the environment and running the services .

Kindly let me know ,if you are facing any other issues.

I have also included the architecture diagram to help you understand the flow . Below are the commid ids and revision ids for the changes made : 1.https://github.com/airavata-courses/Noodle/commit/50bdf1b1e7cc79f480b53c77b8238618dd41578b 2.Revision id - https://github.com/airavata-courses/Noodle/wiki/Home/f6217536b70d296b48bb12dad039118a50b6509c