search

awslabs / amazon-kinesis-agent

Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.
Other
355 stars 222 forks source link

Installation fails with Java 10 #148

Open PicoSushi opened 6 years ago

PicoSushi commented 6 years ago

Description

I ran: git clone --depth=1 https://github.com/awslabs/amazon-kinesis-agent.git && cd amazon-kinesis-agent && sudo ./setup --install And, error message says: /home/ubuntu/amazon-kinesis-agent/build.xml:29: Unsupported Java version: 10. Make sure that the Java version is 1.7 or greater.

I think 10 is greater than 1.7.

My environments

OS: Ubuntu 18.04

$uname -a
Linux ip-172-31-25-224 4.15.0-1021-aws #21-Ubuntu SMP Tue Aug 28 10:23:07 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

Java: 

openjdk version "10.0.2" 2018-07-17
OpenJDK Runtime Environment (build 10.0.2+13-Ubuntu-1ubuntu0.18.04.2)
OpenJDK 64-Bit Server VM (build 10.0.2+13-Ubuntu-1ubuntu0.18.04.2, mixed mode)
PicoSushi commented 6 years ago

Whole message:

Cloning into 'amazon-kinesis-agent'...
Detected OS Distro: Debian
Uninstalling aws-kinesis-agent ...
Removing aws-kinesis-agent from system services...
userdel: user 'aws-kinesis-agent-user' does not exist
Installing Kinesis Agent ...
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  ant-optional
Suggested packages:
  ant-doc antlr javacc junit junit4 jython libactivation-java libbcel-java
  libbsf-java libcommons-logging-java libcommons-net-java libmail-java
  libjaxp1.3-java libjdepend-java libjsch-java liblog4j1.2-java liboro-java
  libregexp-java libxalan2-java libxml-commons-resolver1.1-java libxz-java
The following NEW packages will be installed:
  ant ant-optional
0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded.
Need to get 2430 kB of archives.
After this operation, 3371 kB of additional disk space will be used.
Get:1 http://ap-northeast-1.ec2.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 ant all 1.10.3-1ubuntu0.1 [2061 kB]
Get:2 http://ap-northeast-1.ec2.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 ant-optional all 1.10.3-1ubuntu0.1 [368 kB]
debconf: unable to initialize frontend: Dialog
debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
dpkg-preconfigure: unable to re-open stdin:
Fetched 2430 kB in 1s (4017 kB/s)
Selecting previously unselected package ant.
(Reading database ... 91209 files and directories currently installed.)
Preparing to unpack .../ant_1.10.3-1ubuntu0.1_all.deb ...
Unpacking ant (1.10.3-1ubuntu0.1) ...
Selecting previously unselected package ant-optional.
Preparing to unpack .../ant-optional_1.10.3-1ubuntu0.1_all.deb ...
Unpacking ant-optional (1.10.3-1ubuntu0.1) ...
Setting up ant (1.10.3-1ubuntu0.1) ...
Processing triggers for man-db (2.8.3-2) ...
Setting up ant-optional (1.10.3-1ubuntu0.1) ...
Downloading dependencies ...
Downloading aws-java-sdk-core-1.11.28.jar (http://search.maven.org/remotecontent?filepath=com/amazonaws/aws-java-sdk-core/1.11.28/aws-java-sdk-core-1.11.28.jar)...
Downloading aws-java-sdk-kinesis-1.11.28.jar (http://search.maven.org/remotecontent?filepath=com/amazonaws/aws-java-sdk-kinesis/1.11.28/aws-java-sdk-kinesis-1.11.28.jar)...
Downloading aws-java-sdk-cloudwatch-1.11.28.jar (http://search.maven.org/remotecontent?filepath=com/amazonaws/aws-java-sdk-cloudwatch/1.11.28/aws-java-sdk-cloudwatch-1.11.28.jar)...
Downloading aws-java-sdk-sts-1.11.28.jar (http://search.maven.org/remotecontent?filepath=com/amazonaws/aws-java-sdk-sts/1.11.28/aws-java-sdk-sts-1.11.28.jar)...
Downloading aws-java-sdk-ec2-1.11.28.jar (http://search.maven.org/remotecontent?filepath=com/amazonaws/aws-java-sdk-ec2/1.11.28/aws-java-sdk-ec2-1.11.28.jar)...
Downloading jackson-annotations-2.6.3.jar (http://search.maven.org/remotecontent?filepath=com/fasterxml/jackson/core/jackson-annotations/2.6.3/jackson-annotations-2.6.3.jar)...
Downloading jackson-core-2.6.3.jar (http://search.maven.org/remotecontent?filepath=com/fasterxml/jackson/core/jackson-core/2.6.3/jackson-core-2.6.3.jar)...
Downloading jackson-databind-2.6.3.jar (http://search.maven.org/remotecontent?filepath=com/fasterxml/jackson/core/jackson-databind/2.6.3/jackson-databind-2.6.3.jar)...
Downloading jackson-dataformat-cbor-2.6.3.jar (http://search.maven.org/remotecontent?filepath=com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.3/jackson-dataformat-cbor-2.6.3.jar)...
Downloading jsr305-3.0.1.jar (http://search.maven.org/remotecontent?filepath=com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.jar)...
Downloading guava-18.0.jar (http://search.maven.org/remotecontent?filepath=com/google/guava/guava/18.0/guava-18.0.jar)...
Downloading httpclient-4.5.1.jar (http://search.maven.org/remotecontent?filepath=org/apache/httpcomponents/httpclient/4.5.1/httpclient-4.5.1.jar)...
Downloading httpclient-cache-4.5.1.jar (http://search.maven.org/remotecontent?filepath=org/apache/httpcomponents/httpclient-cache/4.5.1/httpclient-cache-4.5.1.jar)...
Downloading httpmime-4.5.1.jar (http://search.maven.org/remotecontent?filepath=org/apache/httpcomponents/httpmime/4.5.1/httpmime-4.5.1.jar)...
Downloading httpcore-4.4.3.jar (http://search.maven.org/remotecontent?filepath=org/apache/httpcomponents/httpcore/4.4.3/httpcore-4.4.3.jar)...
Downloading httpcore-ab-4.4.3.jar (http://search.maven.org/remotecontent?filepath=org/apache/httpcomponents/httpcore-ab/4.4.3/httpcore-ab-4.4.3.jar)...
Downloading httpcore-nio-4.4.3.jar (http://search.maven.org/remotecontent?filepath=org/apache/httpcomponents/httpcore-nio/4.4.3/httpcore-nio-4.4.3.jar)...
Downloading commons-cli-1.2.jar (http://search.maven.org/remotecontent?filepath=commons-cli/commons-cli/1.2/commons-cli-1.2.jar)...
Downloading commons-codec-1.6.jar (http://search.maven.org/remotecontent?filepath=commons-codec/commons-codec/1.6/commons-codec-1.6.jar)...
Downloading commons-logging-adapters-1.1.jar (http://search.maven.org/remotecontent?filepath=commons-logging/commons-logging-adapters/1.1/commons-logging-adapters-1.1.jar)...
Downloading commons-logging-api-1.1.jar (http://search.maven.org/remotecontent?filepath=commons-logging/commons-logging-api/1.1/commons-logging-api-1.1.jar)...
Downloading commons-lang3-3.4.jar (http://search.maven.org/remotecontent?filepath=org/apache/commons/commons-lang3/3.4/commons-lang3-3.4.jar)...
Downloading log4j-1.2.17.jar (http://search.maven.org/remotecontent?filepath=log4j/log4j/1.2.17/log4j-1.2.17.jar)...
Downloading slf4j-api-1.7.12.jar (http://search.maven.org/remotecontent?filepath=org/slf4j/slf4j-api/1.7.12/slf4j-api-1.7.12.jar)...
Downloading slf4j-log4j12-1.7.12.jar (http://search.maven.org/remotecontent?filepath=org/slf4j/slf4j-log4j12/1.7.12/slf4j-log4j12-1.7.12.jar)...
Downloading jcommander-1.48.jar (http://search.maven.org/remotecontent?filepath=com/beust/jcommander/1.48/jcommander-1.48.jar)...
Downloading sqlite-jdbc-3.8.11.2.jar (http://search.maven.org/remotecontent?filepath=org/xerial/sqlite-jdbc/3.8.11.2/sqlite-jdbc-3.8.11.2.jar)...
Downloading joda-time-2.8.2.jar (http://search.maven.org/remotecontent?filepath=joda-time/joda-time/2.8.2/joda-time-2.8.2.jar)...
Downloading lombok-1.16.6.jar (http://search.maven.org/remotecontent?filepath=org/projectlombok/lombok/1.16.6/lombok-1.16.6.jar)...
Buildfile: /home/ubuntu/amazon-kinesis-agent/build.xml
    amazon-ebs:
clean:
    amazon-ebs:
get-java-version:
    amazon-ebs:
check-java-version:
    amazon-ebs:
BUILD FAILED
/home/ubuntu/amazon-kinesis-agent/build.xml:29: Unsupported Java version: 10. Make sure that the Java version is 1.7 or greater.
    amazon-ebs:
Total time: 0 seconds
akahub commented 5 years ago

Hi, have you managed to find a fix for this one?

Thanks

PicoSushi commented 5 years ago

No.

I've installed Java 9, and it worked well. But, the problem with Java 10 seems not be solved.

ascunha commented 5 years ago

Had the same problem with java 11. first for the java version detection, you have to change the ant build.xml:

    <target name="get-java-version">
      <condition property="current.java.version">
          <!--<or>
          <equals arg1="${ant.java.version}" arg2="1.7"/>
          <equals arg1="${ant.java.version}" arg2="1.8"/>
    </or>-->
    <javaversion atleast="1.8"/>
      </condition>
    </target>

you can bump the source and target in the compilation task if you want too.

It will still not run under java 11 because of some dependencies, lombok should be updated and the jaxb which was deprecated in 9 and removed in 11 should be included in the class path, I did that by changing the setup file:

                  org.projectlombok:lombok:1.18.4 \
                  javax.xml.bind:jaxb-api:2.3.0 \
                  sun.xml.bind:jaxb-impl:2.3.0 \
                  org.glassfish.jaxb:jaxb-runtime:2.3.0 \
                  javax.activation:activation:2.3.0"

I added all this changes to the pom.xml too just for completeness. I'm not running this in production yet, but seems fine in my staging. Hope it helps.

jrotenstein commented 4 years ago

Same problem exists with Amazon Corretto on Amazon Linux 2 AMIs.

If Java is not installed, then installing the Kinesis Agent results in Corretto being installed.

When starting the agent, the error is:

[ec2-user@ip-172-31-42-7 ~]$ cat /tmp/aws-kinesis-agent.20191021010043.initlog 
ERROR:   JVM version >= 1.7 is required. Found following JVM:
         $ /bin/java -version
         openjdk version "11.0.5" 2019-10-15 LTS
                  OpenJDK Runtime Environment Corretto-11.0.5.10.1 (build 11.0.5+10-LTS)
                  OpenJDK 64-Bit Server VM Corretto-11.0.5.10.1 (build 11.0.5+10-LTS, mixed mode)

I solved it by specifically installing Java 1.8 before installing Kinesis Agent.

koenvo commented 4 years ago

Same problem exists with Amazon Corretto on Amazon Linux 2 AMIs.

If Java is not installed, then installing the Kinesis Agent results in Corretto being installed.

When starting the agent, the error is:

[ec2-user@ip-172-31-42-7 ~]$ cat /tmp/aws-kinesis-agent.20191021010043.initlog 
ERROR:   JVM version >= 1.7 is required. Found following JVM:
         $ /bin/java -version
         openjdk version "11.0.5" 2019-10-15 LTS
                  OpenJDK Runtime Environment Corretto-11.0.5.10.1 (build 11.0.5+10-LTS)
                  OpenJDK 64-Bit Server VM Corretto-11.0.5.10.1 (build 11.0.5+10-LTS, mixed mode)

I solved it by specifically installing Java 1.8 before installing Kinesis Agent.

this worked for me. Thanks