Error in build docker - Githubissues

commoncrawl / news-crawl

News crawling with StormCrawler - stores content as WARC

Apache License 2.0

319 stars 34 forks source link

Error in build docker #43

Closed Ashbajawed closed 3 years ago

Ashbajawed commented 3 years ago

Hello I'm getting this error while building the docker

ADD failed: stat /var/lib/docker/tmp/docker-builder779286778/target/crawler-1.17.jar: no such file or directory

PS: I have also tried said path but its also not working

sebastian-nagel commented 3 years ago

Did you create the uberjar? See the note in the README just after the docker build command. Sorry, I'll move the note and also extend the instructions how to compile the Java code (that's mandatory). But let me know whether running mvn package before docker build ... fixes your problem. Thanks!

Ashbajawed commented 3 years ago

that's the issue.. while running command mvn clean package

I'm getting this error

Could not find artifact jdk.tools:jdk.tools:jar:1.7 at specified path /usr/lib/jvm/java-11-openjdk-amd64/../lib/tools.jar

sebastian-nagel commented 3 years ago

The tools.jar was removed for Java 9 and upwards. There are two ways to address this problem:

use Java 8

exclude the transitive dependency in the pom.xml:

    <dependency>
        <groupId>com.digitalpebble.stormcrawler</groupId>
        <artifactId>storm-crawler-warc</artifactId>
        <version>${storm-crawler.version}</version>
        <exclusions>
            <exclusion>
                <!-- not available with Java 9 and higher -->
                <groupId>jdk.tools</groupId>
                <artifactId>jdk.tools</artifactId>
            </exclusion>
      </exclusions>
    </dependency>

I'll also have a look how to fix this problem.