search

idio / json-wikipedia

Json Wikipedia, contains code to convert the Wikipedia xml dump into a json dump. Questions? https://gitter.im/idio-opensource/Lobby
17 stars 2 forks source link

build failure under java-8-openjdk #55

Closed exegetics closed 5 years ago

exegetics commented 5 years ago

This project fails to build under java-8-openjdk

ubuntu@ip-172-17-52-113:~$ sudo rendang run -v MatchNewLanguageIdentifiers --ontologic-revision sbtrun-to-sparksubmit
Running following task:
MatchNewLanguageIdentifiers: 
   jsonpedia_revision: 1.3.0
   language: en
   ontologic_revision: sbtrun-to-sparksubmit
   spark_workers: 16
   wiki: 20170801
   wikidata_date: 20170807
   wikistats_revision: 1.3.0
Continue? [y/n]: y
LEVEL: 0
Tasks missing from all caches (will need to run them):
     MatchNewLanguageIdentifiers(jsonpedia_revision=1.3.0, language=en, ontologic_revision=sbtrun-to-sparksubmit, wikidata_date=20170807, wiki=20170801, wikistats_revision=1.3.0)
LEVEL: 1
Tasks found in cache RemoteCache(http://localhost:8083/remote):
    1) ExtractRedirects(revision=1.3.0, jsonpedia_revision=1.3.0, language=en, wiki=20170801, dirty=False, with_redlinks=False, extra_flags=)
    2) RunWikistatsTitles(revision=1.3.0, jsonpedia_revision=1.3.0, language=en, wiki=20170801, dirty=False, with_redlinks=False, extra_flags=)
    3) RunWikistatsUriCounts(revision=1.3.0, jsonpedia_revision=1.3.0, language=en, wiki=20170801, dirty=False, with_redlinks=False, extra_flags=)
Select which ones you want to download
Range, e.g. "1-5,6,2", or "all".
Type "skip" if you want to ignore this.
Select:
skip
Tasks found in cache LocalCache(/tmp/rendang):
     BuildOntologicJar(revision=sbtrun-to-sparksubmit)
     DownloadS3File(fname=dbpedia_rels, base_path=idiontology/dump/files/dbpedia_rels)
     DownloadS3File(fname=mid_rels, base_path=idiontology/dump/files/mid_rels)
     DownloadS3File(fname=qid_rels, base_path=idiontology/dump/files/qid_rels)
     GetWikidataDisambiguationQids(wikidata_date=20170807, ontologic_revision=sbtrun-to-sparksubmit)
     GetWikidataListQids(wikidata_date=20170807, ontologic_revision=sbtrun-to-sparksubmit)
     GetWikidataQIDMappings(wikidata_date=20170807, ontologic_revision=sbtrun-to-sparksubmit)
LEVEL: 2
Tasks found in cache RemoteCache(http://localhost:8083/remote):
    1) CreateJsonpedia(wiki=20170801, language=en, revision=1.3.0)
Select which ones you want to download
Range, e.g. "1-5,6,2", or "all".
Type "skip" if you want to ignore this.
Select:
skip
Tasks found in cache LocalCache(/tmp/rendang):
     BuildWikistatsJar(revision=1.3.0)
LEVEL: 3
Tasks missing from all caches (will need to run them):
     BuildJsonpediaJar(revision=1.3.0)
Tasks found in cache LocalCache(/tmp/rendang):
     DownloadWikiXmlDump(wiki=20170801, language=en)
Tasks to fetch:
From RemoteCache(http://localhost:8083/remote)
From LocalCache(/tmp/rendang)
    1) BuildOntologicJar(revision=sbtrun-to-sparksubmit)
    2) BuildWikistatsJar(revision=1.3.0)
    3) DownloadS3File(fname=qid_rels, base_path=idiontology/dump/files/qid_rels)
    4) DownloadS3File(fname=dbpedia_rels, base_path=idiontology/dump/files/dbpedia_rels)
    5) DownloadS3File(fname=mid_rels, base_path=idiontology/dump/files/mid_rels)
    6) DownloadWikiXmlDump(wiki=20170801, language=en)
    7) GetWikidataDisambiguationQids(wikidata_date=20170807, ontologic_revision=sbtrun-to-sparksubmit)
    8) GetWikidataListQids(wikidata_date=20170807, ontologic_revision=sbtrun-to-sparksubmit)
    9) GetWikidataQIDMappings(wikidata_date=20170807, ontologic_revision=sbtrun-to-sparksubmit)
Tasks to run:
    1) BuildJsonpediaJar(revision=1.3.0)
    2) CreateJsonpedia(wiki=20170801, language=en, revision=1.3.0)
    3) ExtractRedirects(revision=1.3.0, jsonpedia_revision=1.3.0, language=en, wiki=20170801, dirty=False, with_redlinks=False, extra_flags=)
    4) MatchNewLanguageIdentifiers(jsonpedia_revision=1.3.0, language=en, ontologic_revision=sbtrun-to-sparksubmit, wikidata_date=20170807, wiki=20170801, wikistats_revision=1.3.0)
    5) RunWikistatsTitles(revision=1.3.0, jsonpedia_revision=1.3.0, language=en, wiki=20170801, dirty=False, with_redlinks=False, extra_flags=)
    6) RunWikistatsUriCounts(revision=1.3.0, jsonpedia_revision=1.3.0, language=en, wiki=20170801, dirty=False, with_redlinks=False, extra_flags=)
Do you agree with this evaluation strategy?
Continue? [y/n]: y
Fetching tasks from RemoteCache(http://localhost:8083/remote)...
Fetching tasks from LocalCache(/tmp/rendang)...
Found local branch, pulling
Already on 'sbtrun-to-sparksubmit'
Your branch is up-to-date with 'origin/sbtrun-to-sparksubmit'.
Current branch sbtrun-to-sparksubmit is up to date.
/var/lib/rendang/releases/589f914efc2b4ff2dc0d592fa8d4b9cab648bff4/python_modules/luigi/parameter.py:259: UserWarning: Parameter 16 is not of type string.
  warnings.warn("Parameter {0} is not of type string.".format(str(x)))
/var/lib/rendang/releases/589f914efc2b4ff2dc0d592fa8d4b9cab648bff4/python_modules/luigi/parameter.py:259: UserWarning: Parameter 27 is not of type string.
  warnings.warn("Parameter {0} is not of type string.".format(str(x)))
revision is a tag
HEAD is now at f54f7f4... Merge branch 'release/1.3.0'
/var/lib/rendang/releases/589f914efc2b4ff2dc0d592fa8d4b9cab648bff4/python_modules/luigi/parameter.py:259: UserWarning: Parameter 16 is not of type string.
  warnings.warn("Parameter {0} is not of type string.".format(str(x)))
/var/lib/rendang/releases/589f914efc2b4ff2dc0d592fa8d4b9cab648bff4/python_modules/luigi/parameter.py:259: UserWarning: Parameter 27 is not of type string.
  warnings.warn("Parameter {0} is not of type string.".format(str(x)))
revision is a tag
HEAD is now at f54f7f4... Merge branch 'release/1.3.0'
Building the jar...
>> STRICT CMD: mvn assembly:assembly -Dproject.customVersion=130
[INFO] Scanning for projects...
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Json Wikipedia 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] >>> maven-assembly-plugin:2.4:assembly (default-cli) > package @ json-wikipedia >>>
Downloading: http://zoidberg.ukp.informatik.tu-darmstadt.de/artifactory/public-snapshots/info/bliki/wiki/bliki-core/3.1.1-SNAPSHOT/maven-metadata.xml
Downloading: http://zoidberg.ukp.informatik.tu-darmstadt.de/artifactory/public-snapshots/info/bliki/wiki/bliki/3.1.1-SNAPSHOT/maven-metadata.xml
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ json-wikipedia ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] Copying 36 resources
[INFO] 
[INFO] --- scala-maven-plugin:3.3.1:add-source (scala-compile-first) @ json-wikipedia ---
[INFO] Add Source directory: /tmp/rendang/CloneJsonpedia9f38826c36/src/main/scala
[INFO] Add Test Source directory: /tmp/rendang/CloneJsonpedia9f38826c36/src/test/scala
[INFO] 
[INFO] --- scala-maven-plugin:3.3.1:compile (scala-compile-first) @ json-wikipedia ---
[WARNING]  Expected all dependencies to require Scala version: 2.11.8
[WARNING]  com.twitter:chill_2.11:0.8.0 requires scala version: 2.11.7
[WARNING] Multiple versions of scala libraries detected!
[INFO] /tmp/rendang/CloneJsonpedia9f38826c36/src/main/java:-1: info: compiling
[INFO] /tmp/rendang/CloneJsonpedia9f38826c36/src/main/scala:-1: info: compiling
[INFO] Compiling 30 source files to /tmp/rendang/CloneJsonpedia9f38826c36/target/classes at 1541420959320
[INFO] prepare-compile in 0 s
[INFO] compile in 2 s
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ json-wikipedia ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 28 source files to /tmp/rendang/CloneJsonpedia9f38826c36/target/classes
[INFO] /tmp/rendang/CloneJsonpedia9f38826c36/src/main/java/it/cnr/isti/hpc/wikipedia/parser/ArticleParser.java: /tmp/rendang/CloneJsonpedia9f38826c36/src/main/java/it/cnr/isti/hpc/wikipedia/parser/ArticleParser.java uses unchecked or unsafe operations.
[INFO] /tmp/rendang/CloneJsonpedia9f38826c36/src/main/java/it/cnr/isti/hpc/wikipedia/parser/ArticleParser.java: Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ json-wikipedia ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] Copying 38 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ json-wikipedia ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 9 source files to /tmp/rendang/CloneJsonpedia9f38826c36/target/test-classes
[INFO] /tmp/rendang/CloneJsonpedia9f38826c36/src/test/java/it/cnr/isti/hpc/wikipedia/article/pt/PortugueseArticleTest.java: Some input files use or override a deprecated API.
[INFO] /tmp/rendang/CloneJsonpedia9f38826c36/src/test/java/it/cnr/isti/hpc/wikipedia/article/pt/PortugueseArticleTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ json-wikipedia ---
[INFO] Surefire report directory: /tmp/rendang/CloneJsonpedia9f38826c36/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Error: Could not find or load main class org.apache.maven.surefire.booter.ForkedBooter

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7.145 s
[INFO] Finished at: 2018-11-05T12:29:23+00:00
[INFO] Final Memory: 55M/770M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project json-wikipedia: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test failed: The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /tmp/rendang/CloneJsonpedia9f38826c36 && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -jar /tmp/rendang/CloneJsonpedia9f38826c36/target/surefire/surefirebooter6921009844714323149.jar /tmp/rendang/CloneJsonpedia9f38826c36/target/surefire/surefire694424674136682093tmp /tmp/rendang/CloneJsonpedia9f38826c36/target/surefire/surefire_03886515638232077927tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException

probably related to https://stackoverflow.com/questions/53010200/maven-surefire-could-not-find-forkedbooter-class

exegetics commented 5 years ago

fixed by #57