search

onedata / getting-started

A collection of installation scripts for getting started with Onedata.
MIT License
4 stars 7 forks source link

Scenario 2.0 - service_couchbase:init_cluster failed - insufficient RAM on macos #38

Closed carmat88 closed 7 years ago

carmat88 commented 7 years ago

Hey guys! I'm trying to deploy scenario 2.0 on my local machine (not a VM) which is MacOS Sierra version 10.12.6 (16G29) with Docker version 17.06.2-ce, build cec0b72 and docker-compose version 1.14.0, build c7bdf9e

When running in the 1st terminal window the command ./run_onedata.sh --zone, I'm getting the following error message:

onezone-1        | Error: Service Error
onezone-1        | Description: Action 'deploy' for a service 'onezone' terminated with an error.
onezone-1        | Module: service_couchbase
onezone-1        | Function: init_cluster
onezone-1        | Hosts: node1.onezone.
onezone-1        | For more information please check the logs.
onezone-1 exited with code 1

Here is the stacktrace checking the error.log at var/log/oz_panel:

2017-09-07 08:27:18.664 [error] <0.372.0>@service_utils:log:242 Step service_couchbase:init_cluster failed
Node: 'onepanel@node1.onezone.'
Reason: {ok,400,
            #{<<"Cache-Control">> => <<"no-cache">>,
              <<"Content-Length">> => <<"107">>,
              <<"Content-Type">> => <<"application/json">>,
              <<"Date">> => <<"Thu, 07 Sep 2017 08:27:18 GMT">>,
              <<"Pragma">> => <<"no-cache">>,
              <<"Server">> => <<"Couchbase Server">>},
            <<"{\"errors\":{\"_\":\"Total quota (4196MB) exceeds the maximum allowed quota (1599MB) on node 'ns_1@127.0.0.1'\"}}">>}
Stacktrace: [{service_couchbase,init_cluster,1,
                 [{file,
                      "/build/oz-panel-wVdlny/oz-panel-17.06.0.rc2/_build/package/lib/onepanel/src/services/modules/service_couchbase.erl"},
                  {line,187}]},
             {onepanel_rpc,apply,3,
                 [{file,
                      "/build/oz-panel-wVdlny/oz-panel-17.06.0.rc2/_build/package/lib/onepanel/src/modules/onepanel_rpc.erl"},
                  {line,41}]},
             {rpc,'-handle_call_call/6-fun-0-',5,
                 [{file,"rpc.erl"},{line,187}]}]
2017-09-07 08:27:18.666 [error] <0.372.0>@service_utils:log:235 Action onezone:deploy failed due to: {service_couchbase,init_cluster,
                                      {[],
                                       [{'onepanel@node1.onezone.',
                                         {error,onepanel_rpc,apply,3,
                                          undefined,
                                          {ok,400,
                                           #{<<"Cache-Control">> => <<"no-cache">>,
                                             <<"Content-Length">> => <<"107">>,
                                             <<"Content-Type">> => <<"application/json">>,
                                             <<"Date">> => <<"Thu, 07 Sep 2017 08:27:18 GMT">>,
                                             <<"Pragma">> => <<"no-cache">>,
                                             <<"Server">> => <<"Couchbase Server">>},
                                           <<"{\"errors\":{\"_\":\"Total quota (4196MB) exceeds the maximum allowed quota (1599MB) on node 'ns_1@127.0.0.1'\"}}">>},
                                          [{service_couchbase,init_cluster,1,
                                            [{file,
                                              "/build/oz-panel-wVdlny/oz-panel-17.06.0.rc2/_build/package/lib/onepanel/src/services/modules/service_couchbase.erl"},
                                             {line,187}]},
                                           {onepanel_rpc,apply,3,
                                            [{file,
                                              "/build/oz-panel-wVdlny/oz-panel-17.06.0.rc2/_build/package/lib/onepanel/src/modules/onepanel_rpc.erl"},
                                             {line,41}]},
                                           {rpc,'-handle_call_call/6-fun-0-',
                                            5,
                                            [{file,"rpc.erl"},{line,187}]}],
                                          43}}]}}
Stacktrace: [{io_lib_pretty,cind_tag_tuple,7,
                            [{file,"io_lib_pretty.erl"},{line,637}]},
             {io_lib_pretty,cind_element,7,
                            [{file,"io_lib_pretty.erl"},{line,726}]},
             {io_lib_pretty,cind_list,7,
                            [{file,"io_lib_pretty.erl"},{line,696}]},
             {io_lib_pretty,cind_element,7,
                            [{file,"io_lib_pretty.erl"},{line,726}]},
             {io_lib_pretty,cind_tail,8,
                            [{file,"io_lib_pretty.erl"},{line,709}]},
             {io_lib_pretty,cind_element,7,
                            [{file,"io_lib_pretty.erl"},{line,726}]},
             {io_lib_pretty,cind_list,7,
                            [{file,"io_lib_pretty.erl"},{line,696}]},
             {io_lib_pretty,while_fail,3,
                            [{file,"io_lib_pretty.erl"},{line,737}]}]
2017-09-07 08:27:19.043 [error] <0.390.0>@onepanel_errors:translate:157 Function: onepanel_rpc:apply/3
Args: undefined
Reason: {ok,400,
            #{<<"Cache-Control">> => <<"no-cache">>,
              <<"Content-Length">> => <<"107">>,
              <<"Content-Type">> => <<"application/json">>,
              <<"Date">> => <<"Thu, 07 Sep 2017 08:27:18 GMT">>,
              <<"Pragma">> => <<"no-cache">>,
              <<"Server">> => <<"Couchbase Server">>},
            <<"{\"errors\":{\"_\":\"Total quota (4196MB) exceeds the maximum allowed quota (1599MB) on node 'ns_1@127.0.0.1'\"}}">>}
Stacktrace: [{service_couchbase,init_cluster,1,
                 [{file,
                      "/build/oz-panel-wVdlny/oz-panel-17.06.0.rc2/_build/package/lib/onepanel/src/services/modules/service_couchbase.erl"},
                  {line,187}]},
             {onepanel_rpc,apply,3,
                 [{file,
                      "/build/oz-panel-wVdlny/oz-panel-17.06.0.rc2/_build/package/lib/onepanel/src/modules/onepanel_rpc.erl"},
                  {line,41}]},
             {rpc,'-handle_call_call/6-fun-0-',5,
                 [{file,"rpc.erl"},{line,187}]}]
Line: 43

Based on the log, there seems to be an issue with the server couchbase and that init_cluster failed. The specific error might be related to some quota exceeding thresholds.

What is interesting is that, if I run scenario 2.0 on a Linux machine (Ubuntu 16.04 LTS), then commands ./run_onedata.sh --zone and ./run_onedata.sh --provider work like a charm.

Tried to google such error about quota and found these two posts on the couchbase's forum:

Though, I couldn't figure it out. That is why I thought it was worthy to report the aforementioned issue here. Hope it could be useful somehow!

Many thanks.

groundnuty commented 7 years ago

From the top of my head please check how much RAM you have allocated to your Docker: image you need 4GB minimum as the log says.

I will try to deploy it on my Mac later this week - we usually use Linux for that.

carmat88 commented 7 years ago

Hello @groundnuty . Thank you for getting back. Indeed, I had to ramp it up to 6 GB in order to make it work. Is this somehow expected? Cheers.

groundnuty commented 7 years ago

@carmat88 yea... when I get around to add this: https://github.com/onedata/getting-started/issues/24 - the message will be very clear :-)

It did not want to start with less then 6GB?

carmat88 commented 7 years ago

@groundnuty Hi again. Nice! I saw that issue, but trivially did not connect the dots XD

So for my local setup it seems that 5.5GB is the threshold below which ./run_onedata.sh --zone starts failing. Many thanks for the hint about adjusting dedicated RAM to Docker.

groundnuty commented 7 years ago

Thanks for estimating minimum RAM needed for macos !

On Thu, Sep 7, 2017 at 1:46 PM carmat88 notifications@github.com wrote:

@groundnuty https://github.com/groundnuty Hi again. Nice! I saw that issue, but trivially did not connect the dots XD

So for my local setup it seems that 5.5GB is the threshold below which ./run_onedata.sh --zone starts failing. Many thanks for the hint about adjusting dedicated RAM to Docker.

— You are receiving this because you were mentioned.

Reply to this email directly, view it on GitHub https://github.com/onedata/getting-started/issues/38#issuecomment-327775766, or mute the thread https://github.com/notifications/unsubscribe-auth/AAOuphdNWnKj3zNztKviNLlO0yA7ZF8Mks5sf9eAgaJpZM4PPhMe .