archivesunleashed / aut

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
https://aut.docs.archivesunleashed.org/
Apache License 2.0
137 stars 33 forks source link

Command line app fails because of missing log4j configuration #433

Closed ruebot closed 4 years ago

ruebot commented 4 years ago

Describe the bug Command line app fails because of missing log4j configuration

To Reproduce Steps to reproduce the behavior (e.g.):

  1. bin/spark-submit --master local\[8\] ~/Projects/au/aut-releases/aut-0.50.0-fatjar.jar --extractor DomainFrequencyExtractor --input /home/nruest/Projects/au/sample-data/geocities/* --output /home/nruest/Projects/au/sample-data/app-output/DomainFrequencyExtractor

This will produce a misleading message when Spark fires up, then exit without running.

log4j:WARN No appenders could be found for logger (io.archivesunleashed.app.CommandLineApp).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Environment information

Additional context

One resolution here could be that we ship a sample log4j configuration like this in src/resources, and then document it.

ruebot commented 4 years ago

:man_facepalming: we do ship one https://github.com/archivesunleashed/aut/blob/master/src/main/resources/log4j.properties