search

aboutcode-org / scancode-toolkit

:mag: ScanCode detects licenses, copyrights, dependencies by "scanning code" ... to discover and inventory open source and third-party packages used in your code. Sponsored by NLnet project https://nlnet.nl/project/vulnerabilitydatabase, the Google Summer of Code, Azure credits, nexB and others generous sponsors!
https://github.com/aboutcode-org/scancode-toolkit/releases/
2.11k stars 546 forks source link

Check if all these licenses are detected #1381

Open pombredanne opened 5 years ago

pombredanne commented 5 years ago

See https://openmodelica.org/svn/OpenModelica/branches/requirements/PythonInterface/PySimulator/Icons/open_icon_library-standard_LICENSES.txt

######################################################
#                    Icon Licenses                   #
######################################################

Open Icon Library currently uses icons from many different 
sources, using various free/open licenses.  This file lists the 
various sources and their respective licenses.  For more 
detailed documentation of the icons licenses, authors and 
file lists see the docs/ folder. 

Icons from the various sources are stored in the developers 
package, open_icon_library-devel. Each source is place in a 
separate directories, whose name is listed below. The 
open_icon_library-full, open_icon_library-CC, 
open_icon_library-GPL, and open_icon_library-PD packages have 
the various sources combined, and sorted file type and image 
size.  To see which icons came from which packages look it 
the 'docs' directory for the FILELIST files, or download the 
developers package.  To see how they are combined download the 
developers package or icon_tools package, and look at 
the icon-tools/make_directories_stageX.sh scripts.

In addition these documents, each file is embeded with its 
license and source in the metadata.

#####################################################
# Open Icon Library Packages

To give various option to developers 4 packages are available,
sorted by common licenses. These packages ONLY use icons with the licenses listed

open_icon_library-devel (Multiply License)
open_icon_library-full  (Multiply License)
open_icon_library-standard (Multiply License)
open_icon_library-win   (Multiply License)
open_icon_library-mac   (Multiply License)
    List of licenses used in these packages:
        Creative Commons Attribution 
        Creative Commons Attribution-Share Alike 
        GNU General Public License  
        GNU Lesser General Public License
        MIT License
        BSD License
        Public Domain

open_icon_library-devel-CC  (Creative Commons and Public Domain only)
open_icon_library-CC        (Creative Commons and Public Domain only)
    List of licenses used in these packages:
        Creative Commons Attribution 
        Creative Commons Attribution-Share Alike 
        Public Domain

open_icon_library-devel-GPL (GPL, LGPL, and Public Domain only)
open_icon_library-GPL       (GPL, LGPL, and Public Domain only)
    List of licenses used in these packages:
        GNU General Public License 
        GNU Lesser General Public License 
        Public Domain

open_icon_library-devel-PD (Public domain only)
open_icon_library-PD (Public domain only)
    List of licenses used in these packages:
        Public Domain

######################################################
# Links to Free/Open Licenses used

Creative Commons Attribution 1.0 Generic (CC-BY 1.0)
    link: http://creativecommons.org/licenses/by/1.0/

Creative Commons Attribution 2.0 Generic (CC-BY 2.0)
    link: http://creativecommons.org/licenses/by/2.0/

Creative Commons Attribution 2.5 Generic (CC-BY 2.5)
    link: http://creativecommons.org/licenses/by/2.5/

Creative Commons Attribution 3.0 Unported (CC-BY 3.0)
    link: http://creativecommons.org/licenses/by/3.0/

Creative Commons Attribution-Share Alike 1.0 Generic (CC-BY-SA 1.0)
    link: http://creativecommons.org/licenses/by-sa/1.0/

Creative Commons Attribution-Share Alike 2.0 Generic (CC-BY-SA 2.0)
    link: http://creativecommons.org/licenses/by-sa/2.0/

Creative Commons Attribution-Share Alike 2.5 Generic (CC-BY-SA 2.5)
    link: http://creativecommons.org/licenses/by-sa/2.5/

Creative Commons Attribution-Share Alike 3.0 Unported (CC-BY-SA 3.0)
    link: http://creativecommons.org/licenses/by-sa/3.0/

GNU General Public License 2 (GPLv2)
    link: http://creativecommons.org/licenses/GPL/2.0/

GNU General Public License 3 (GPLv3)
    link: http://creativecommons.org/licenses/GPL/3.0/

GNU Lesser General Public License 2.1 (LGPL)
    link: http://creativecommons.org/licenses/LGPL/2.1/

GNU Lesser General Public License 3.0 (LGPLv3)
    link: http://www.gnu.org/licenses/lgpl-3.0.txt

MIT License (MIT)
    link: http://creativecommons.org/licenses/MIT/

BSD License (BSD)
    link: http://creativecommons.org/licenses/BSD/

Public Domain (PD)
    link: http://en.wikipedia.org/wiki/Public_domain

List of other Free/Open licenses (not used)
    link: http://www.gnu.org/philosophy/license-list.html

#####################################################
# Licenses used by icon's sources
#

AEM Pictorial Database (aem) 
    link: http://www.aem.org/Technical/PictorialDatabase/index.asp
    license: PD
    license link: http://en.wikipedia.org/wiki/Public_domain
    format: eps -> svg, png
    subdirectory: open_icon_library-devel/icons/aem

app-install-data (app-install)
    link: http://packages.debian.org/lenny/app-install-data
    licenses: Various, see docs/AUTHORS_app-install
    license link: see docs/AUTHORS_app-install
    format: xpm, svg, png
    subdirectory:  open_icon_library-devel/icons/app-install

Creative Commons (cc)
    link: http://creativecommons.org/about/downloads
    license: CC-BY 3.0 
    license link: http://creativecommons.org/licenses/by/3.0/
    formats: svg, png
    subdirectories: open_icon_library-devel/icons/cc
                    open_icon_library-devel/icons_by_subject/cc

Crystal Clear (crystal_clear)
    link: http://commons.wikimedia.org/wiki/Crystal_Clear
    license: LGPL-2.1
    license link: http://creativecommons.org/licenses/LGPL/2.1/
    formats: png
    subdirectories: open_icon_library-devel/icons/crystal_clear
                    open_icon_library-devel/icons_by_subject/crystal_clear

Crystal Project (crystal)
    link: http://everaldo.com/crystal/
    license: LGPL-2.1
    license link: http://creativecommons.org/licenses/LGPL/2.1/
    formats: png, ico
    subdirectory: open_icon_library-devel/icons/crystal

Technische Regeln für Arbeitsstätten (DIN Standard) (din)
    link: http://www.baua.de/nn_56926/de/Themen-von-A-Z/Arbeitsstaetten/ASR/pdf/ASR-A1-3.pdf
    license: Public Domain
    license link: http://en.wikipedia.org/wiki/Public_domain
    format: pdf -> svg, png
    subdirectory: open_icon_library-devel/icons/din

echo-icon-theme (echo)
    link: https://fedorahosted.org/echo-icon-theme/
    license: CC-BY-SA 3.0
    License link: http://creativecommons.org/licenses/by-sa/3.0/
    formats: png
    subdirectories: open_icon_library-devel/icons/echo

FAMFAMFAM Flag Icons (famfamfam-flag)
    link: http://www.famfamfam.com/lab/icons/flags/
    license: Public Domain
    license link: http://en.wikipedia.org/wiki/Public_domain
    formats: png
    subdirectory: open_icon_library-devel/icons/famfamfam-flag

FAMFAMFAM Silk Icons 1.3 (famfamfam-silk)
    link: http://www.famfamfam.com/lab/icons/silk/
    license: CC-BY-2.5 or CC-BY-3.0
    license link: http://creativecommons.org/licenses/by/3.0/
            http://creativecommons.org/licenses/by/2.5/
    formats: png
    subdirectory: open_icon_library-devel/icons/famfamfam-silk

fineicons (fineicons)
    link: http://www.fineicons.com/en/free-icons/credit-cards/
    license: CC-BY-SA-2.0-UK
    license link: http://creativecommons.org/licenses/by-sa/2.0/uk/
    formats: gif -> png
    subdirectory: open_icon_library-devel/icons_by_subject/fineicons

Gimp 2.6 (gimp)
    link: http://www.gimp.org/
    license: GPLv2
    license link: http://creativecommons.org/licenses/GPL/2.0/
    formats: png
    subdirectories: open_icon_library-devel/icons_by_subject/gimp

GNOME Icon Theme 2.26.0 (gnome)
    link: http://art.gnome.org/
    license: GPLv2 
    license link: http://creativecommons.org/licenses/GPL/2.0/
    formats: svg, png
    subdirectories: open_icon_library-devel/icons/gnome
                    open_icon_library-devel/icons_by_subject/gnome

GNOME-Colors (gnome_colors)
    link: http://code.google.com/p/gnome-colors/
    license: GPLv2
    license link: http://creativecommons.org/licenses/GPL/2.0/
    formats: svg, png
    subdirectories: open_icon_library-devel/icons/gnome-colors
                    open_icon_library-devel/icons_by_subject/gnome-colors

Hawidu (hawidu)
    link: http://hawidu.com/
    license: Public Domain
    license link: http://en.wikipedia.org/wiki/Public_domain
    formats: png
    subdirectories: open_icon_library-devel/icons_by_subject/hawidu

IconIcon.Net (iconicon_net)
    link: http://iconicon.net/
    license: Public Domain
    license link: http://en.wikipedia.org/wiki/Public_domain
    formats: png
    subdirectories: open_icon_library-devel/icons_by_subject/iconicon_net

Inkscape (inkscape)
    link: http://www.inkscape.org/
    license: GPLv2
    license link: http://creativecommons.org/licenses/GPL/2.0/
    format: svg 
    subdirectories: open_icon_library-devel/icons_by_subject/inkscape

Intrigue Icon Set 0.6.2 [Green] (intrigue)
    link: http://simpleinnovation.net/index.php?page=22&source=2&id=2
    license: GPLv2
    license link: http://creativecommons.org/licenses/GPL/2.0/
    formats: png
    subdirectory: open_icon_library-devel/icons/intrigue

nuoveXT2 (nuovext2)
    link: http://nuovext.pwsp.net
    license: LGPL-2.1
    license link: http://creativecommons.org/licenses/LGPL/2.1/
    formats: png
    subdirectory: open_icon_library-devel/icons/nuovext2

Nuvola 1.0 (KDE 3.x icon set) (nuvola)
    link: http://www.icon-king.com/projects/nuvola/
    license: LGPL-2.1
    license link: http://creativecommons.org/licenses/LGPL/2.1/
    formats: png
    subdirectory: open_icon_library-devel/icons/nuvola

map-icons-collection (map-icons-collection)
    link: http://code.google.com/p/google-maps-icons/
    license: CC-BY-SA 3.0
    license link: http://creativecommons.org/licenses/by-sa/3.0/ 
    format: png
    subdirectory:  open_icon_library-devel/icons_by_subject/map-icons-collection

Map Symbols & Patterns for NPS Maps (nps)
    link: http://www.nps.gov/hfc/carto/map-symbols.htm
    aquired: 27 Dec 2009
    license: Public Domain
    license link: http://en.wikipedia.org/wiki/Public_domain
    format: pdf -> png, svg
    subdirectory:  open_icon_library-devel/icons/nps
    subdirectory:  open_icon_library-devel/icons_by_subject/nps

Open Clip Art Library (open_clip_art_library)
    link: http://openclipart.org
    license: Public Domain
    license link: http://en.wikipedia.org/wiki/Public_domain
    format: svg -> png
    subdirectory: open_icon_library-devel/icons/open_clip_art_library

Open Icon Library (homemade)
    link: http://openiconlibrary.sourceforge.net/
    license: Public Domain
    license link: http://en.wikipedia.org/wiki/Public_domain
    format: svg -> png
    subdirectories: open_icon_library-devel/icons/homemade
                    open_icon_library-devel/icons_by_subject/homemade

OpenOffice.org default theme 3.2 (openoffice)
    link: http://www.openoffice.org/
    license: GPLv3
    license link: http://creativecommons.org/licenses/GPL/3.0/
    format: png 
    subdirectories: open_icon_library-devel/icons_by_subject/openoffice

OpenStreetMap (openstreetmap)
    link: http://wiki.openstreetmap.org/wiki/Map_Icons
    license: Public Domain
    license link: http://en.wikipedia.org/wiki/Public_domain
    format: svg
    subdirectories: open_icon_library-devel/icons_by_subject/openstreetmap

Oxygen Icons 4.3.1 (KDE) (oxygen)
    link: http://www.oxygen-icons.org/
    license: Dual: CC-BY-SA 3.0 or LGPL
    License link: http://creativecommons.org/licenses/by-sa/3.0/
            http://creativecommons.org/licenses/LGPL/2.1/
    formats: svg, png
    subdirectory: open_icon_library-devel/icons/oxygen

Quantum GIS (qgis)
    link: http://www.qgis.org/
    license: GPLv2
    license link: http://creativecommons.org/licenses/GPL/2.0/
    formats: svg
    subdirectory: open_icon_library-devel/icons_by_subject/qgis

Tango Icon Library 0.8.90 (tango)
    link: http://tango.freedesktop.org/Tango_Icon_Library
    license: Public Domain 
    License link: http://en.wikipedia.org/wiki/Public_domain
    formats: svg, png
    subdirectory: open_icon_library-devel/icons/tango

Tango harm-on-icons (tango-harm)
    link: http://gnome-look.org/content/show.php/Tango+mine?content=76316
    license: CC-BY 3.0 
    License link: http://creativecommons.org/licenses/by/3.0/
    formats: svg->png 
    subdirectory: open_icon_library-devel/icons/tango-harm

Warthan's Stuff: Sovereign State Flags of the World (warthan)
    link: http://warthan.org/nation_flags.html
    license: GPL
    License link: http://creativecommons.org/licenses/GPL/2.0/
    formats: png
    subdirectory: open_icon_library-devel/icons/warthan

Wikimedia Commons
    link: http://commons.wikimedia.org/wiki/Main_Page
    license: CC, GPL, PD, MIT, BSD (in separate directories)
    License link: see docs/AUTHORS_wiki_commons*
    format: svg, png
    subdirectory: open_icon_library-devel/icons/wiki_commons_bsd
    subdirectory: open_icon_library-devel/icons/wiki_commons_mit
    subdirectories: open_icon_library-devel/icons/wiki_commons_cc
                open_icon_library-devel/icons_by_subject/wiki_commons_cc
    subdirectories: open_icon_library-devel/icons/wiki_commons_gpl
                open_icon_library-devel/icons_by_subject/wiki_commons_gpl
    subdirectories: open_icon_library-devel/icons/wiki_commons_pd
                open_icon_library-devel/icons_by_subject/wiki_commons_pd
    See AUTHORS_wiki_commons* for details on each image with license info

WPClipart (wpclipart)
    link: http://www.wpclipart.com/
    license: PD
    License link: http://en.wikipedia.org/wiki/Public_domain
    formats: png
    subdirectories: open_icon_library-devel/icons/wpclipart
                    open_icon_library-devel/icons_by_subject/wpclipart

xfce4-icon-theme (xfce4)
    link: http://www.xfce.org/
    license: GPLv2
    License link: http://creativecommons.org/licenses/GPL/2.0/
    formats: svg -> png, ico, icns, xpm
    subdirectories: open_icon_library-devel/icons/xfce4

######################################
# Some other sources (not added yet):
Spheres Free Icons (not added yet)
    link: http://www.mouserunner.com/Spheres_Icons_Index.html
    license: Public Domain
    formats:
DOT pictograms 
    link: http://www.aiga.org/content.cfm/symbol-signs
    license: PD
    format: ttf ?-> svg, png
    subdirectory: open_icon_library-devel/icons/dot
Waring symols
    ANSI Z535
    BGV A8
    IEC 6131
    SEMI S1-0701
    ISO 3864
pombredanne commented 5 years ago

See also https://openmodelica.org/svn/OpenModelica/branches/requirements/PythonInterface/PySimulator/Icons/LICENSES.txt

#################################################################
#################################################################
#######                                                   #######
#######               Open Icon Library                   #######
#######    Relevant Parts of Original License File        #######
#######                                                   #######
#################################################################
#################################################################

##################################################################
## Licenses:

Creative Commons Attribution-Share Alike 3.0 Unported (CC-BY-SA 3.0)
    link: http://creativecommons.org/licenses/by-sa/3.0/

GNU Lesser General Public License 2.1 (LGPL)
    link: http://creativecommons.org/licenses/LGPL/2.1/

Public Domain (PD)
    link: http://en.wikipedia.org/wiki/Public_domain

###################################################
## File List:
##

File Name   /    Source    /   License
office-chart-line-stacked.png / oxygen / CC-BY-SA 3.0 or LGPL
zoom-in-5.png / oxygen / CC-BY-SA 3.0 or LGPL
view-right-close.png / oxygen / CC-BY-SA 3.0 or LGPL
view-right-new-3.png / oxygen / CC-BY-SA 3.0 or LGPL
window-new-6.png / oxygen / CC-BY-SA 3.0 or LGPL
draw-eraser-2.png / oxygen / CC-BY-SA 3.0 or LGPL
document-save-5.png / oxygen / CC-BY-SA 3.0 or LGPL
anonymous_simple_weather_symbols_1.png / open_clip_art_library / PD
mnpw commented 5 years ago
  1. I observe that duplicate licenses are not excluded; Is the redundant listing of licenses by design or is this a bug?
  2. Is manual comparison of the source file and with the license scan output required for this issue?

Note: some fields are omitted in json license scan dump

License Scan: File 1

"license_expressions": [
        "gpl-1.0-plus",
        "gpl-1.0-plus",
        "mit",
        "bsd-new",
        "public-domain",
        "public-domain",
        "public-domain",
        "public-domain",
        "gpl-1.0-plus",
        "gpl-1.0-plus",
        "lgpl-2.0-plus",
        "public-domain",
        "gpl-1.0-plus",
        "gpl-1.0-plus",
        "lgpl-2.0-plus",
        "public-domain",
        "gpl-1.0-plus",
        "public-domain",
        "public-domain",
        "public-domain",
        "public-domain",
        "cc-by-1.0",
        "cc-by-1.0",
        "cc-by-2.0",
        "cc-by-2.0",
        "cc-by-2.5",
        "cc-by-2.5",
        "cc-by-3.0",
        "cc-by-3.0",
        "cc-by-sa-1.0",
        "cc-by-sa-1.0",
        "cc-by-sa-2.0",
        "cc-by-sa-2.0",
        "cc-by-sa-2.5",
        "cc-by-sa-2.5",
        "cc-by-sa-3.0",
        "cc-by-sa-3.0",
        "gpl-1.0-plus",
        "gpl-2.0",
        "gpl-2.0",
        "gpl-1.0-plus",
        "gpl-3.0",
        "gpl-3.0",
        "lgpl-2.0-plus",
        "lgpl-2.1",
        "lgpl-2.1-plus",
        "lgpl-3.0",
        "mit",
        "mit AND bsd-new",
        "bsd-new",
        "public-domain",
        "public-domain",
        "public-domain",
        "public-domain",
        "cc-by-3.0",
        "cc-by-3.0",
        "lgpl-2.1",
        "lgpl-2.1",
        "lgpl-2.1",
        "lgpl-2.1",
        "public-domain",
        "public-domain",
        "cc-by-sa-3.0",
        "cc-by-sa-3.0",
        "public-domain",
        "public-domain",
        "cc-by-2.5",
        "cc-by-3.0",
        "cc-by-3.0",
        "cc-by-2.5",
        "cc-by-sa-2.5",
        "gpl-2.0",
        "gpl-2.0",
        "gpl-2.0",
        "gpl-2.0",
        "gpl-2.0",
        "gpl-2.0",
        "public-domain",
        "public-domain",
        "public-domain",
        "public-domain",
        "gpl-2.0",
        "gpl-2.0",
        "gpl-2.0",
        "gpl-2.0",
        "lgpl-2.1",
        "lgpl-2.1",
        "lgpl-2.1",
        "lgpl-2.1",
        "cc-by-sa-2.5",
        "public-domain",
        "public-domain",
        "public-domain",
        "public-domain",
        "public-domain",
        "public-domain",
        "gpl-3.0",
        "gpl-3.0",
        "public-domain",
        "public-domain",
        "cc-by-sa-3.0",
        "lgpl-2.0-plus",
        "cc-by-sa-3.0",
        "lgpl-2.1",
        "gpl-2.0",
        "gpl-2.0",
        "public-domain",
        "public-domain",
        "cc-by-3.0",
        "cc-by-3.0",
        "gpl-1.0-plus",
        "gpl-2.0",
        "gpl-1.0-plus",
        "mit AND bsd-new",
        "gpl-1.0-plus",
        "gpl-1.0-plus",
        "public-domain",
        "public-domain",
        "gpl-2.0",
        "gpl-2.0",
        "public-domain",
        "public-domain"
      ]

License Scan: File 2 

"license_expressions": [
        "cc-by-sa-3.0",
        "cc-by-sa-3.0",
        "lgpl-2.1-plus",
        "lgpl-2.0-plus",
        "lgpl-2.1",
        "public-domain",
        "public-domain",
        "cc-by-sa-3.0",
        "lgpl-2.0-plus",
        "cc-by-sa-3.0",
        "lgpl-2.0-plus",
        "cc-by-sa-3.0",
        "lgpl-2.0-plus",
        "cc-by-sa-3.0",
        "lgpl-2.0-plus",
        "cc-by-sa-3.0",
        "lgpl-2.0-plus",
        "cc-by-sa-3.0",
        "lgpl-2.0-plus",
        "cc-by-sa-3.0",
        "lgpl-2.0-plus"
      ]
hamzam1997 commented 5 years ago

All Licenses are detected

I am attaching the htmls for both files. I have verified both the files manually also. LicenseDetection_Verified.zip file2 file1

pombredanne commented 5 years ago

@mriiinal

  1. I observe that duplicate licenses are not excluded; Is the redundant listing of licenses by design or is this a bug?

We always list everything, never remove dupes by design.

  1. Is manual comparison of the source file and with the license scan output required for this issue?

Typically yes. You may want to use the --license-text to get extra details

pombredanne commented 5 years ago

@hamzam1997 thanks. Using --json-pp - --license-text is IMHO required with a creful review of the license text and detected license texts to make sure

  1. nothing is skipped
  2. the license coverage and score are reasonably high
hamzam1997 commented 5 years ago

@pombredanne I will definitely work again using --json-pp - --license-text

hamzam1997 commented 5 years ago

@pombredanne I have sent a PR request for it. Please review for any changes needed

pombredanne commented 5 years ago

@hamzam1997 the way to get this done is explained in a few places. In particular here https://github.com/nexB/scancode-toolkit/issues/296#issuecomment-284451265

n1khilmane commented 4 years ago

Hey!! @pombredanne may i know how much is the work done regarding the issue, so i can work on this issue?