Compare websites with our own list

[tejasjyothishetty]

Great Repository @StevenBlack And countless others. I have a list of my own which may have more sites to block. Is there an easy way of comparing them to the biggest list Unified +.... ? A lot of others who see this repo may also have the same issue

[welcome[bot]]

Hello! Thank you for opening your first issue in this repo. It’s people like you who make these host files better!

[StevenBlack]

Hi Tejas @tejasjyothishetty thank you for your question.

I wrote a utility in Golang named ghosts which, by default, uses the base amalgamated list as a comparison basis.

To compare any list to the full amalgamated list, you would invoke it like this:

# "fgps" means use base + Fakenews + Gambling + Porn + Social

$ ghosts -m fgps -c PATH-OR-URL-TO-YOUR-HOSTS-FILE

Here's the help emitted by ghosts:

$ ghosts --help                                                                                         

Usage of ghosts:
  -c string
        Hosts list to compare.
        A shortcut code, full URL, or a local file.
        Use the -m option for the main comparison list.
        Use the -clip option to use what is on the system clipboard.

        Shortcut codes
        ==============
        The following shortcut codes can be used to select among preset main lists.

        Amalgamated lists' shortcuts:
        -c b or -m base // use Steven Black's base amalgamated list.
        -c f    // use alternates/fakenews/hosts
        -c fg   // use alternates/fakenews-gambling/hosts
        -c fgp  // use alternates/fakenews-gambling-porn/hosts
        -c fgps // use alternates/fakenews-gambling-porn-social/hosts
        -c fgs  // use alternates/fakenews-gambling-social/hosts
        -c fp   // use alternates/fakenews-porn/hosts
        -c fps  // use alternates/fakenews-porn-social/hosts
        -c fs   // use alternates/fakenews-social/hosts
        -c g    // use alternates/gambling/hosts
        -c gp   // use alternates/gambling-porn/hosts
        -c gps  // use alternates/gambling-porn-social/hosts
        -c gs   // use alternates/gambling-social/hosts
        -c p    // use alternates/porn/hosts
        -c ps   // use alternates/porn-social/hosts
        -c s    // use alternates/social/hosts

        Source lists' shortcuts:
        -c adaway                // adaway.github.io
        -c add2o7net             // FadeMind add.2o7Net hosts
        -c adddead               // FadeMind add.Dead hosts
        -c addrisk               // FadeMind add.Risk hosts
        -c addspam               // FadeMind add.Spam hosts
        -c adguard               // AdguardTeam cname-trackers
        -c baddboyz              // mitchellkrogza Badd-Boyz-Hosts
        -c clefspear             // Clefspeare13 pornhosts
        -c digitalside           // davidonzo Threat-Intel
        -c fakenews              // marktron/fakenews
        -c hostsvn               // bigdargon hostsVN
        -c kadhosts              // PolishFiltersTeam
        -c metamask              // MetaMask eth-phishing hosts
        -c mvps                  // winhelp2002.mvps.or
        -c orca                  // orca.pet notonmyshift hosts
        -c shady                 // hreyasminocha shady hosts
        -c sinfonietta-gambling
        -c sinfonietta-porn
        -c sinfonietta-snuff
        -c sinfonietta-social
        -c someonewhocares       // Sam Pollock someonewhocares.org
        -c stevenblack           // Steven Black ad-hoc list
        -c tiuxo-porn
        -c tiuxo-social
        -c tiuxo                 // tiuxo list.
        -c uncheckyads           // FadeMind  UncheckyAds
        -c urlhaus               // urlhaus.abuse.ch
        -c yoyo                  // Peter Lowe yoyo.org

  -clip
        The comparison hosts are in the system clipboard
  -d    Include default hosts at the top of file.
  -intersection
        Return the list of intersection hosts? (default false)
  -ip string
        Localhost IP address (default "0.0.0.0")
  -m string
        The main list of hosts to analyze, or serve as a basis for comparison.
        A shortcut code, a full URL, or a local file.
        See the -c flag for the list of shortcut codes. (default "base")
  -noheader
        Remove the file header from output? (default false)
  -o    Return the list of hosts? (default false)
  -p    Return a plain output list of hosts, with no IP address prefix? (default false)
  -root
        Return the list of root domains and their tally (default false)
  -s    Sort the hosts? (default false)
  -stats
        display stats? (default true)
  -tld
        Return the list of TLD and their tally (default false)
  -unique
        List the unique domains in the comparison list
  -v    Return the current version