单机部署完成就jstorm后,首次提交topolgy提示：there's no enough worker. allocWorkerNum=1, availableWorkerNum=0

Arlinlol commented 8 years ago

配置文件如下,大神帮看一下：

storm.zookeeper.servers:

"localhost" storm.zookeeper.root: "/jstorm" nimbus.host: "localhost" storm.local.dir: "%JSTORM_HOME%/data" supervisor.slots.ports:

6800

6801

6802

6803

xiaoyao2102 commented 8 years ago

你用 jstorm list 看一下supervisor有多少可用的slots

Arlinlol commented 8 years ago

{
  "nimbus": {
    "nimbusMaster": {
      "host": "127.0.1.1:8627",
      "uptimeSecs": "4570"
    },
    "nimbusSlaves": [],
    "supervisorNum": 1,
    "totalPortNum": 0,
    "usedPortNum": 0,
    "freePortNum": 0,
    "version": "2.1.1",
    "__isset_bitfield": 15
  },
  "supervisors": [
    {
      "host": "127.0.1.1",
      "supervisorId": "222ac3f8-1530-48e7-958a-e7ad7cd8d800",
      "uptimeSecs": 4381,
      "numWorkers": 0,
      "numUsedWorkers": 0,
      "__isset_bitfield": 7
    }
  ],
  "topologies": []
}

Arlinlol commented 8 years ago

是我哪里设置错误了么

fengjian428 commented 8 years ago

找到Supervisor进程，看jstorm.home引用的位置是否一致

Arlinlol commented 8 years ago

@fengjian428 是一样的.... > echo $JSTORM_HOME /home/arlin/jstorm/jstorm-2.1.1 > ps -ef | grep supervisor arlin 7340 7296 0 15:17 pts/20 00:00:20 java -server -Djstorm.home=/home/arlin/jstorm/jstorm-2.1.1 -Dstorm.options= -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Xms1g -Xmx1g -Xmn512m -XX:PermSize=64m -XX:+UseConcMarkSweepGC -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -XX:CMSFullGCsBeforeCompaction=5 -XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=100M -XX:+UseCMSCompactAtFullCollection -XX:CMSMaxAbortablePrecleanTime=5000 -Xloggc:/home/arlin/jstorm/jstorm-2.1.1/logs/supervisor-gc-1461820409.log -Dlogfile.name=supervisor.log -Dlogback.configurationFile=/home/arlin/jstorm/jstorm-2.1.1/conf/jstorm.logback.xml -Djstorm.log.dir=/home/arlin/jstorm/jstorm-2.1.1/logs ........

fengjian428 commented 8 years ago

supervisor.log 里面有error信息吗

longdafeng commented 8 years ago

@Arlinlol 2.1.1 包里面有个bug， github 源码里面已经打了patch，我重新编译一下代码，你重新安装一下

Arlinlol commented 8 years ago

@longdafeng 谢谢你，昨天我给您gmail邮箱发了一封邮件，是咨询业务场景，技术选型的适用性问题的。其中描述了业务场景，想要您在百忙之中给一些意见。

longdafeng commented 8 years ago

@Arlinlol , 不好意思，我没有收到你的邮件，你能单独再发我一份邮件吗？

zhongyan.feng@alibaba-inc.com

longdafeng commented 8 years ago

@Arlinlol 昨晚重新打包了，把最新的几个patch打进去了

wufuwei commented 7 years ago

@longdafeng 我昨天下载最新的2.1.1 的包，部署后运行 sequence_test 还是这样的问题，通过 jstorm list 可以看到，共有"totalPortNum": 16, "freePortNum": 12, 异常还是：2781 [main] WARN backtype.storm.StormSubmitter - Failed to assign Fail to sumbit topology, Root cause:there's no enough worker. allocWorkerNum=3, availableWorkerNum=0

Successfully get cluster info { "nimbus": { "nimbusMaster": { "host": "10.12.9.171:8627", "uptimeSecs": "4086" }, "nimbusSlaves": [ { "host": "10.12.9.170:8627", "uptimeSecs": "3971" } ], "supervisorNum": 4, "totalPortNum": 16, "usedPortNum": 4, "freePortNum": 12, "version": "2.1.1", "isset_bitfield": 15 }, "supervisors": [ { "host": "10.12.8.174", "supervisorId": "2d7ecbf2-6da9-4165-8497-17b061f8755c", "uptimeSecs": 3600, "numWorkers": 4, "numUsedWorkers": 0, "__isset_bitfield": 7 }, { "host": "10.12.8.175", "supervisorId": "5d764ef6-80b5-4f3a-95e7-40f79959e08e", "uptimeSecs": 3481, "numWorkers": 4, "numUsedWorkers": 0, "isset_bitfield": 7 },

alibaba / jstorm

单机部署完成就jstorm后,首次提交topolgy提示：there's no enough worker. allocWorkerNum=1, availableWorkerNum=0 #251