search

trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
10.36k stars 2.98k forks source link

Flaky hive-tests (config-hdp3) due to "address already in use" #9768

Closed ebyhr closed 1 month ago

ebyhr commented 2 years ago 
+ . plugin/trino-hive-hadoop2/bin/common.sh
++ SCRIPT_DIR=plugin/trino-hive-hadoop2/bin
++ INTEGRATION_TESTS_ROOT=plugin/trino-hive-hadoop2/bin/..
++ PROJECT_ROOT=plugin/trino-hive-hadoop2/bin/../../..
++ DOCKER_COMPOSE_LOCATION=plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml
++ source plugin/trino-hive-hadoop2/bin/../conf/hive-tests-defaults.sh
+++ ./mvnw --version
++++ ./mvnw help:evaluate -Dexpression=dep.docker.images.version -q -DforceStdout
+++ DEFAULT_DOCKER_VERSION=50
+++ '[' -z 50 ']'
+++ export DOCKER_IMAGES_VERSION=50
+++ DOCKER_IMAGES_VERSION=50
+++ export HADOOP_BASE_IMAGE=ghcr.io/trinodb/testing/hdp3.1-hive
+++ HADOOP_BASE_IMAGE=ghcr.io/trinodb/testing/hdp3.1-hive
++ docker-compose version
docker-compose version 1.29.2, build 5becea4c
docker-py version: 5.0.0
CPython version: 3.7.10
OpenSSL version: OpenSSL 1.1.0l  10 Sep 2019
++ docker version
Client:
 Version:           20.10.9+azure-1
 API version:       1.41
 Go version:        go1.16.8
 Git commit:        c2ea9bc90bacf19bdbe37fd13eec8772432aca99
 Built:             Thu Sep 23 18:26:34 2021
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true

Server:
 Engine:
  Version:          20.10.9+azure-1
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.16.8
  Git commit:       79ea9d3080181d755855d5924d0f4f116faa9463
  Built:            Thu Sep 23 18:26:18 2021
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.4.11+azure
  GitCommit:        5b46e404f6b9f661a205e28d59c982d3634148f8
 runc:
  Version:          1.0.2
  GitCommit:        52b36a2dd837e8462de8e01458bf02cf9eea47dd
 docker-init:
  Version:          0.19.0
  GitCommit:        
++ '[' -n '' ']'
++ PROXY=127.0.0.1
+ cleanup_hadoop_docker_containers
+ cleanup_docker_containers plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml
++ expand_compose_args plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml
++ files=("${@}")
++ local files
++ local compose_args=
++ for file in ${files[@]}
++ compose_args+=' -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml'
++ echo ' -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml'
+ local 'compose_args= -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml'
+ docker-compose -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml down --remove-orphans
Removing network conf_default
Network conf_default not found.
+ wait
+ start_hadoop_docker_containers
+ start_docker_containers plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml
++ expand_compose_args plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml
++ files=("${@}")
++ local files
++ local compose_args=
++ for file in ${files[@]}
++ compose_args+=' -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml'
++ echo ' -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml'
+ local 'compose_args= -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml'
+ docker-compose -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml down
Removing network conf_default
Network conf_default not found.
+ TRAP_ARGS=plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml
+ trap 'termination_handler $TRAP_ARGS' INT TERM
+ [[ true == \t\r\u\e ]]
+ docker-compose -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml pull --quiet
+ docker-compose -f plugin/trino-hive-hadoop2/bin/../conf/docker-compose.yml up -d
Creating network "conf_default" with the default driver
Creating conf_hadoop-master_1 ... 
Host is already in use by another container
Creating conf_hadoop-master_1 ... error

ERROR: for conf_hadoop-master_1  Cannot start service hadoop-master: driver failed programming external connectivity on endpoint conf_hadoop-master_1 (0ec584210ed8cf000409d84817e4acc2818e5d3503aea995de482af67ba5ba56): Error starting userland proxy: listen tcp4 0.0.0.0:50070: bind: address already in use

ERROR: for hadoop-master  Cannot start service hadoop-master: driver failed programming external connectivity on endpoint conf_hadoop-master_1 (0ec584210ed8cf000409d84817e4acc2818e5d3503aea995de482af67ba5ba56): Error starting userland proxy: listen tcp4 0.0.0.0:50070: bind: address already in use
Encountered errors while bringing up the project.
Error: Process completed with exit code 1.

https://github.com/trinodb/trino/runs/4004326444

ebyhr commented 2 years ago

https://github.com/trinodb/trino/runs/4917761727