mosabua
commented
4 years ago Here is a list of all the jar files (sorted and duplicates removed):
HdrHistogram-2.1.9.jar JavaFastPFOR-0.0.13.jar RoaringBitmap-0.8.0.jar accumulo-core-1.7.4.jar accumulo-fate-1.7.4.jar accumulo-start-1.7.4.jar aether-api-1.13.1.jar aether-connector-asynchttpclient-1.13.1.jar aether-connector-file-1.13.1.jar aether-impl-1.13.1.jar aether-spi-1.13.1.jar aether-util-1.13.1.jar aggs-matrix-stats-client-6.0.0.jar aircompressor-0.16.jar alluxio-shaded-client-2.1.2.jar amazon-kinesis-client-1.6.3.jar animal-sniffer-annotations-1.18.jar annotations-18.0.0.jar annotations-4.1.1.4.jar antlr-2.7.7.jar antlr-runtime-3.4.jar antlr4-runtime-4.7.1.jar aopalliance-1.0.jar api-common-1.9.0.jar asm-6.2.1.jar asm-analysis-6.2.1.jar asm-tree-6.2.1.jar asm-util-6.2.1.jar async-1.4.1.jar async-http-client-1.6.5.jar audience-annotations-0.5.0.jar auto-value-annotations-1.6.5.jar auto-value-annotations-1.7.jar avatica-core-1.13.0.jar avatica-core-1.16.0.jar avatica-metrics-1.16.0.jar avro-1.9.2.jar aws-java-sdk-cloudwatch-1.10.61.jar aws-java-sdk-core-1.11.749.jar aws-java-sdk-dynamodb-1.11.749.jar aws-java-sdk-glue-1.11.749.jar aws-java-sdk-kinesis-1.11.749.jar aws-java-sdk-kms-1.11.749.jar aws-java-sdk-s3-1.11.749.jar aws-java-sdk-sts-1.11.749.jar bcrypt-0.9.0.jar bootstrap-0.198.jar bval-jsr-2.0.0.jar bytecode-1.2.jar bytes-1.3.0.jar caffeine-2.7.0.jar calcite-babel-1.19.0.jar calcite-core-1.19.0.jar calcite-linq4j-1.19.0.jar cassandra-driver-3.1.4-2.jar cglib-nodep-3.3.0.jar checker-compat-qual-2.5.5.jar checker-qual-2.11.1.jar commons-beanutils-1.7.0.jar commons-beanutils-core-1.8.0.jar commons-cli-1.2.jar commons-codec-1.10.jar commons-codec-1.11.jar commons-codec-1.3.jar commons-codec-1.4.jar commons-codec-1.6.jar commons-collections-3.2.1.jar commons-collections-3.2.2.jar commons-compress-1.20.jar commons-configuration-1.6.jar commons-digester-1.8.jar commons-httpclient-3.1.jar commons-io-2.4.jar commons-lang-2.4.jar commons-lang-2.6.jar commons-lang3-3.4.jar commons-lang3-3.5.jar commons-lang3-3.8.jar commons-math-2.1.jar commons-math3-3.6.1.jar commons-pool2-2.0.jar commons-vfs2-2.2.jar concurrent-0.198.jar configuration-0.198.jar conscrypt-openjdk-uber-2.2.1.jar curator-client-2.12.0.jar curator-framework-2.12.0.jar dbpool-0.198.jar discovery-0.198.jar discovery-server-1.29.jar disruptor-3.3.4.jar drift-api-1.14.jar drift-client-1.14.jar drift-codec-1.14.jar drift-protocol-1.14.jar drift-transport-netty-1.14.jar drift-transport-spi-1.14.jar duct-tape-1.0.8.jar elasticsearch-6.0.0.jar elasticsearch-rest-client-6.0.0.jar elasticsearch-rest-high-level-client-6.0.0.jar error_prone_annotations-2.3.4.jar esri-geometry-api-2.2.2.jar event-0.198.jar expiringmap-0.5.6.jar failsafe-2.0.1.jar failureaccess-1.0.1.jar fastutil-8.3.0.jar findbugs-annotations-1.3.9-1.jar flogger-0.4.jar flogger-log4j-backend-0.4.jar flogger-system-backend-0.4.jar gax-1.55.0.jar gax-grpc-1.55.0.jar gax-httpjson-0.72.0.jar gcs-connector-hadoop2-2.0.0.jar gcsio-2.0.0.jar google-api-client-1.23.0.jar google-api-client-1.30.1.jar google-api-client-1.30.9.jar google-api-client-jackson2-1.30.1.jar google-api-client-java6-1.30.1.jar google-api-services-bigquery-v2-rev20191211-1.30.9.jar google-api-services-sheets-v4-rev516-1.23.0.jar google-api-services-storage-v1-rev20190624-1.30.1.jar google-auth-library-credentials-0.20.0.jar google-auth-library-oauth2-http-0.20.0.jar google-cloud-bigquery-1.110.0.jar google-cloud-bigquerystorage-0.126.0-beta.jar google-cloud-core-1.93.3.jar google-cloud-core-http-1.93.3.jar google-extensions-0.4.jar google-http-client-1.23.0.jar google-http-client-1.30.1.jar google-http-client-1.34.2.jar google-http-client-appengine-1.34.2.jar google-http-client-jackson2-1.23.0.jar google-http-client-jackson2-1.30.1.jar google-http-client-jackson2-1.34.2.jar google-oauth-client-1.23.0.jar google-oauth-client-1.30.1.jar google-oauth-client-1.30.5.jar google-oauth-client-java6-1.30.1.jar grpc-alts-1.28.1.jar grpc-api-1.28.1.jar grpc-auth-1.28.1.jar grpc-context-1.19.0.jar grpc-context-1.28.1.jar grpc-core-1.28.1.jar grpc-grpclb-1.28.1.jar grpc-netty-shaded-1.28.1.jar grpc-protobuf-1.28.1.jar grpc-protobuf-lite-1.28.1.jar grpc-stub-1.28.1.jar gson-2.8.6.jar guava-29.0-jre.jar guice-4.2.3.jar guice-multibindings-4.2.3.jar h2-1.4.200.jar hadoop-apache-2.7.7-1.jar hadoop-apache-3.2.0-9.jar hamcrest-core-1.3.jar helix-core-0.9.4.jar hive-apache-3.0.0-4.jar hk2-api-2.5.0-b42.jar hk2-locator-2.5.0-b42.jar hk2-utils-2.5.0-b42.jar hppc-0.7.1.jar http-client-0.198.jar http-server-0.198.jar http2-client-9.4.27.v20200227.jar http2-common-9.4.27.v20200227.jar http2-hpack-9.4.27.v20200227.jar http2-http-client-transport-9.4.27.v20200227.jar http2-server-9.4.27.v20200227.jar httpasyncclient-4.1.2.jar httpclient-4.0.1.jar httpclient-4.5.11.jar httpclient-4.5.2.jar httpclient-4.5.3.jar httpclient-4.5.8.jar httpclient-4.5.9.jar httpcore-4.0.1.jar httpcore-4.4.11.jar httpcore-4.4.13.jar httpcore-4.4.5.jar httpcore-4.4.6.jar httpcore-nio-4.4.5.jar httpmime-4.5.3.jar iceberg-api-0.7.0-incubating.jar iceberg-common-0.7.0-incubating.jar iceberg-core-0.7.0-incubating.jar iceberg-hive-0.7.0-incubating.jar iceberg-orc-0.7.0-incubating.jar iceberg-parquet-0.7.0-incubating.jar ion-java-1.0.2.jar j2objc-annotations-1.3.jar jackson-annotations-2.10.3.jar jackson-core-2.10.3.jar jackson-core-asl-1.8.5.jar jackson-databind-2.10.3.jar jackson-dataformat-cbor-2.10.3.jar jackson-dataformat-smile-2.10.3.jar jackson-dataformat-yaml-2.10.3.jar jackson-datatype-guava-2.10.3.jar jackson-datatype-jdk8-2.10.3.jar jackson-datatype-joda-2.10.3.jar jackson-datatype-jsr310-2.10.3.jar jackson-mapper-asl-1.8.5.jar jackson-module-parameter-names-2.10.3.jar javassist-3.22.0-GA.jar javax.activation-api-1.2.0.jar javax.annotation-api-1.3.2.jar javax.inject-1.jar javax.servlet-api-4.0.1.jar javax.ws.rs-api-2.1.jar jaxb-api-2.3.1.jar jaxrs-0.198.jar jcl-over-slf4j-1.7.30.jar jdbi-2.78.jar jdbi3-core-3.4.0.jar jdbi3-sqlobject-3.4.0.jar jedis-2.6.2.jar jersey-client-2.26.jar jersey-client-2.28.jar jersey-common-2.26.jar jersey-common-2.28.jar jersey-container-servlet-2.26.jar jersey-container-servlet-core-2.26.jar jersey-hk2-2.26.jar jersey-media-jaxb-2.26.jar jersey-media-jaxb-2.28.jar jersey-server-2.26.jar jersey-server-2.28.jar jetty-alpn-client-9.4.27.v20200227.jar jetty-alpn-java-client-9.4.27.v20200227.jar jetty-client-9.4.27.v20200227.jar jetty-http-9.4.27.v20200227.jar jetty-io-9.4.27.v20200227.jar jetty-jmx-9.4.27.v20200227.jar jetty-security-9.4.27.v20200227.jar jetty-server-9.4.27.v20200227.jar jetty-servlet-9.4.27.v20200227.jar jetty-util-9.4.27.v20200227.jar jgrapht-core-0.9.0.jar jjwt-0.9.0.jar jmespath-java-1.11.749.jar jmx-0.198.jar jmx-http-0.198.jar jmx-http-rpc-0.159.jar jmxutils-1.21.jar jna-5.5.0.jar jna-platform-5.5.0.jar joda-time-2.10.5.jar jol-core-0.2.jar joni-2.1.5.3.jar jopt-simple-4.6.jar jopt-simple-5.0.2.jar json-0.198.jar jsr305-3.0.2.jar jts-core-1.16.1.jar junit-4.12.jar junixsocket-common-2.0.4.jar junixsocket-native-common-2.0.4.jar kafka-clients-2.4.1.jar kudu-client-1.10.0.jar larray-0.2.1.jar larray-buffer-0.2.1.jar larray-mmap-0.2.1.jar leveldb-0.10.jar leveldb-api-0.10.jar libsvm-3.18.1.jar libthrift-0.9.3-1.jar log-0.198.jar log-manager-0.198.jar log4j-1.2.17.jar log4j-api-2.9.1.jar log4j-core-2.9.1.jar log4j-over-slf4j-1.7.30.jar logback-core-1.2.3.jar lucene-analyzers-common-8.4.1.jar lucene-core-7.0.1.jar lucene-core-8.4.1.jar lucene-queries-8.2.0.jar lucene-queryparser-7.0.1.jar lucene-queryparser-8.2.0.jar lucene-sandbox-8.2.0.jar lz4-java-1.6.0.jar mariadb-java-client-2.4.0.jar maven-aether-provider-3.0.4.jar maven-artifact-3.0.4.jar maven-compat-3.0.4.jar maven-core-3.0.4.jar maven-embedder-3.0.4.jar maven-model-3.0.4.jar maven-model-builder-3.0.4.jar maven-plugin-api-3.0.4.jar maven-repository-metadata-3.0.4.jar maven-settings-3.0.4.jar maven-settings-builder-3.0.4.jar metrics-core-2.2.0.jar metrics-core-3.1.2.jar metrics-core-3.2.3.jar mongo-java-driver-3.6.0.jar mssql-jdbc-7.0.0.jre8.jar mysql-connector-java-5.1.48.jar native-lib-loader-2.0.2.jar netty-3.10.6.Final.jar netty-3.6.2.Final.jar netty-all-4.1.28.Final.jar netty-all-4.1.29.Final.jar netty-buffer-4.0.37.Final.jar netty-codec-4.0.37.Final.jar netty-common-4.0.37.Final.jar netty-handler-4.0.37.Final.jar netty-transport-4.0.37.Final.jar node-0.198.jar ojdbc8-19.3.0.0.jar okhttp-3.9.0.jar okhttp-urlconnection-3.9.0.jar okio-1.13.0.jar ons-19.3.0.0.jar opencensus-api-0.21.0.jar opencensus-api-0.24.0.jar opencensus-contrib-http-util-0.21.0.jar opencensus-contrib-http-util-0.24.0.jar opencsv-2.3.jar oraclepki-19.3.0.0.jar orc-protobuf-10.jar osdt_cert-19.3.0.0.jar osdt_core-19.3.0.0.jar osgi-resource-locator-1.0.1.jar parameternames-1.4.jar parent-join-client-6.0.0.jar pcollections-2.1.2.jar perfmark-api-0.19.0.jar phoenix-client-4.14.1-HBase-1.4-embedded.jar pinot-common-0.3.0.jar pinot-core-0.3.0.jar pinot-spi-0.3.0.jar plexus-cipher-1.7.jar plexus-classworlds-2.4.jar plexus-component-annotations-1.5.5.jar plexus-container-default-1.5.5.jar plexus-interpolation-1.14.jar plexus-sec-dispatcher-1.3.jar plexus-utils-2.0.6.jar postgresql-42.2.5.jar postgresql-9.3-1102-jdbc41.jar presto-accumulo-337-services.jar presto-accumulo-337.jar presto-accumulo-iterators-337.jar presto-array-337.jar presto-atop-337-services.jar presto-atop-337.jar presto-base-jdbc-337.jar presto-bigquery-337-services.jar presto-bigquery-337.jar presto-blackhole-337-services.jar presto-blackhole-337.jar presto-cassandra-337-services.jar presto-cassandra-337.jar presto-client-337.jar presto-druid-337-services.jar presto-druid-337.jar presto-elasticsearch-337-services.jar presto-elasticsearch-337.jar presto-example-http-337-services.jar presto-example-http-337.jar presto-geospatial-337-services.jar presto-geospatial-337.jar presto-geospatial-toolkit-337.jar presto-google-sheets-337-services.jar presto-google-sheets-337.jar presto-hive-337.jar presto-hive-hadoop2-337-services.jar presto-hive-hadoop2-337.jar presto-iceberg-337-services.jar presto-iceberg-337.jar presto-jmx-337-services.jar presto-jmx-337.jar presto-kafka-337-services.jar presto-kafka-337.jar presto-kinesis-337-services.jar presto-kinesis-337.jar presto-kudu-337-services.jar presto-kudu-337.jar presto-local-file-337-services.jar presto-local-file-337.jar presto-main-337.jar presto-matching-337.jar presto-memory-337-services.jar presto-memory-337.jar presto-memory-context-337.jar presto-memsql-337-services.jar presto-memsql-337.jar presto-ml-337-services.jar presto-ml-337.jar presto-mongodb-337-services.jar presto-mongodb-337.jar presto-mysql-337-services.jar presto-mysql-337.jar presto-oracle-337-services.jar presto-oracle-337.jar presto-orc-337.jar presto-parquet-337.jar presto-parser-337.jar presto-password-authenticators-337-services.jar presto-password-authenticators-337.jar presto-phoenix-337-services.jar presto-phoenix-337.jar presto-pinot-337-services.jar presto-pinot-337.jar presto-plugin-toolkit-337.jar presto-postgresql-337-services.jar presto-postgresql-337.jar presto-prometheus-337-services.jar presto-prometheus-337.jar presto-raptor-legacy-337-services.jar presto-raptor-legacy-337.jar presto-rcfile-337.jar presto-record-decoder-337.jar presto-redis-337-services.jar presto-redis-337.jar presto-redshift-337-services.jar presto-redshift-337.jar presto-resource-group-managers-337-services.jar presto-resource-group-managers-337.jar presto-server-main-337.jar presto-session-property-managers-337-services.jar presto-session-property-managers-337.jar presto-spi-337.jar presto-sqlserver-337-services.jar presto-sqlserver-337.jar presto-teradata-functions-337-services.jar presto-teradata-functions-337.jar presto-thrift-337-services.jar presto-thrift-337.jar presto-thrift-api-337.jar presto-tpcds-337-services.jar presto-tpcds-337.jar presto-tpch-337-services.jar presto-tpch-337.jar proto-google-cloud-bigquerystorage-v1-0.91.0.jar proto-google-cloud-bigquerystorage-v1alpha2-0.91.0.jar proto-google-cloud-bigquerystorage-v1beta1-0.91.0.jar proto-google-cloud-bigquerystorage-v1beta2-0.91.0.jar proto-google-common-protos-1.17.0.jar proto-google-iam-v1-0.13.0.jar protobuf-java-3.11.4.jar protobuf-java-3.6.1.jar protobuf-java-util-3.11.4.jar re2j-td-1.4.jar resolver-1.5.jar rubix-presto-shaded-0.3.12.jar securesm-1.1.jar security-0.198.jar shims-0.8.0.jar simplefan-19.3.0.0.jar slf4j-api-1.7.30.jar slf4j-jdk14-1.7.30.jar slice-0.38.jar snakeyaml-1.15.jar snakeyaml-1.16.jar snappy-java-1.1.7.3.jar stats-0.198.jar stream-2.7.0.jar stringtemplate-3.2.1.jar swagger-ui-2.2.2.jar t-digest-3.0.jar t-digest-3.2.jar tcp-unix-socket-proxy-1.0.2.jar testcontainers-1.13.0.jar testing-0.198.jar threetenbp-1.4.2.jar tpcds-1.3.jar tpch-1.0.jar trace-token-0.198.jar ucp-19.3.0.0.jar units-1.6.jar util-2.0.0.jar util-hadoop-hadoop2-2.0.0.jar validation-api-2.0.1.Final.jar visible-assertions-2.1.2.jar wagon-provider-api-2.2.jar xbean-reflect-3.4.jar xerial-core-2.1.jar xerial-core-3.2.2.jar zkclient-0.5.jar zookeeper-3.4.13.jar zstd-jni-1.4.3-1.jar
findepi
nineinchnick
The docker container prestosql/presto:337 contains numerous jar files that should not be needed. They should be removed from the container (and probably the rpm and tar.gz files as well).
Reasons for them not being needed:
Here are some examples
animal-sniffer-annotations-1.18.jar avatica-core-1.13.0.jar avatica-core-1.16.0.jar commons-codec-1.10.jar commons-codec-1.11.jar commons-codec-1.3.jar commons-codec-1.4.jar commons-codec-1.6.jar commons-collections-3.2.1.jar commons-collections-3.2.2.jar commons-lang-2.4.jar commons-lang-2.6.jar commons-lang3-3.4.jar commons-lang3-3.5.jar commons-lang3-3.8.jar findbugs-annotations-1.3.9-1.jar httpclient-4.0.1.jar httpclient-4.5.11.jar httpclient-4.5.2.jar httpclient-4.5.3.jar httpclient-4.5.8.jar httpclient-4.5.9.jar junit-4.12.jar
We probably should use dependency management in the top level pom to clean this up in terms of version and exclusions on the packaging in provisio and/or the pom files for various plugins.