Collision logging, Transformers for JSON and Standard Files

[Master-Code-Programmer]

This is the PR #773, but on a new, rebased branch (the original PR was made 2 years ago).

Hi, I fitted the collsion_logging merge request from chapmajs to your current source code (https://github.com/johnrengelman/shadow/pull/126). Also I followed your wish to use typed parameters (which was really needed, because after adding them, some problems became obvious).

After that I used the modified plugin and with the warnings I could fix my problems instantly. Great!

The only problem was, that I was flooded with warnings about colliding META-INF/NOTICE, META-INF/license.txt, readme.txt and similar files. So I added a transformer, StandardFilesMergeTransformer, which takes these standard files, which exist in all big projects in big numbers, and merges them. Since these are all pretty primitive files regarding their structure, no special YAML or JSON files, I just concatenate their contents the following way:

• Standard files are "META-INF/license", "META-INF/notice", "META-INF/readme" or "readme". Which may have the following extensions: none, "txt", "md", "htm" or "html".

• If a standard file is found (case insensitive), its content is read, stripped of leading and trailing newlines, and then searched in the list of already existing contents of that file. The search is case insensitive.

  • If no existing entry was found a new entry is created and its content and origin is recorded.
  • If an existing entry is found, its list of origins is extended with the origin of the content.

• Later, the transformed entries are written like that:

  Origins: attoparser-2.0.5.RELEASE.jar, commons-codec-1.15.jar
  
                               Apache License
                         Version 2.0, January 2004
  ...
  ================================================================================
  Origins: flyway-core-8.5.4.jar, flyway-mysql-8.5.4.jar
  
  Copyright (C) Red Gate Software Ltd 2010-2022
  
  Licensed under the Apache License, Version 2.0 (the "License");
  ...

• The StandardFilesMergeTransformer transformer is added as default. It can be removed with "removeDefaultTransformers". I added it as default because otherwise:

  • In projects with many dependencies the user gets flooded with information about duplicate entries like "META-INF/notice.txt", "META-INF/license.txt"...
  • Important licensing information written in META-INF/license.txt and other files may be lost.
  • Helpful information written in readme files may be lost.
  • The merging of this plain text files is safe, there is no important logic to follow. Merged HTML may not look that good, but it works.

• Added JsonTransformer for JSON files, based on JsonTransformer from @LogicFan. Their code is also under Apache License 2. Extended it, so it can be applied to multiple files.

• Lowered the logging level for colliding META-INF/MANIFEST.MF files, from warning to debug, so the user doesn't get flooded with unimportant messages.

• In discussion #710 it came to light that some people need the original module-info.class not to be removed, which is also a possible source for file collision problems. While it's hard to find a nice, quick solution for that, I at least added an option to include the module-info files and list their contents (listing appears only if module-info.class's aren't excluded). The option is: allowModuleInfos(), and used in action in def 'Tests the info about the module-info.class, if removed from standard excludes'().

With that changes, any user should be capable to build a fat JAR with more than one Spring (Boot) dependency, right out of the box. Otherwise it's a real pain to find out which files collide, and how to merge colliding JSON files, since that is the only colliding file type, which misses a merging transformer from this plugin. And JSON is very common!

[Goooler]

Sorry for the delay. Can you rebase again? I changed a lot on the main...

[Master-Code-Programmer]

Sorry for the delay. Can you rebase again? I changed a lot on the main...

Did the rebase.