Expand cluster by two more data nodes (performance is bad)

[feridtola]

Hi, I added two more datanodes to the cluster but the performance is very bad. I just edit the docker-compose.yml. Do I have to configure/change anything else?

`version: "3"

services: namenode: image: bde2020/hadoop-namenode:2.0.0-hadoop3.2.1-java8 container_name: namenode restart: always ports:

• 9870:9870
• 9000:9000 volumes:
• hadoop_namenode:/hadoop/dfs/name environment:
• CLUSTER_NAME=test env_file:

• ./hadoop.env

  datanode: image: bde2020/hadoop-datanode:2.0.0-hadoop3.2.1-java8 container_name: datanode restart: always volumes:

• hadoop_datanode:/hadoop/dfs/data environment: SERVICE_PRECONDITION: "namenode:9870" env_file:

• ./hadoop.env

  datanode1: image: bde2020/hadoop-datanode:2.0.0-hadoop3.2.1-java8 container_name: datanode1 restart: always volumes:

• hadoop_datanode1:/hadoop/dfs/data environment: SERVICE_PRECONDITION: "namenode:9870" env_file:

• ./hadoop.env

  datanode2: image: bde2020/hadoop-datanode:2.0.0-hadoop3.2.1-java8 container_name: datanode2 restart: always volumes:

• hadoop_datanode2:/hadoop/dfs/data environment: SERVICE_PRECONDITION: "namenode:9870" env_file:

• ./hadoop.env

  resourcemanager: image: bde2020/hadoop-resourcemanager:2.0.0-hadoop3.2.1-java8 container_name: resourcemanager restart: always environment: SERVICE_PRECONDITION: "namenode:9000 namenode:9870 datanode:9864" env_file:

• ./hadoop.env

  nodemanager1: image: bde2020/hadoop-nodemanager:2.0.0-hadoop3.2.1-java8 container_name: nodemanager restart: always environment: SERVICE_PRECONDITION: "namenode:9000 namenode:9870 datanode:9864 resourcemanager:8088" env_file:

• ./hadoop.env

  nodemanager2: image: bde2020/hadoop-nodemanager:2.0.0-hadoop3.2.1-java8 container_name: nodemanager2 restart: always environment: SERVICE_PRECONDITION: "namenode:9000 namenode:9870 datanode:9864 resourcemanager:8088" env_file:

• ./hadoop.env

  nodemanager3: image: bde2020/hadoop-nodemanager:2.0.0-hadoop3.2.1-java8 container_name: nodemanager3 restart: always environment: SERVICE_PRECONDITION: "namenode:9000 namenode:9870 datanode:9864 resourcemanager:8088" env_file:

• ./hadoop.env

  historyserver: image: bde2020/hadoop-historyserver:2.0.0-hadoop3.2.1-java8 container_name: historyserver restart: always environment: SERVICE_PRECONDITION: "namenode:9000 namenode:9870 datanode:9864 resourcemanager:8088" volumes:

• hadoop_historyserver:/hadoop/yarn/timeline env_file:
• ./hadoop.env

volumes: hadoop_namenode: hadoop_datanode: hadoop_datanode1: hadoop_datanode2: hadoop_historyserver: `

[gsavelev]

feridtola

What you mean in "performance is very bad"?