dd86k / ddgst

#️⃣ dd's hashing utility with a twist
Creative Commons Zero v1.0 Universal
10 stars 0 forks source link
blake2 bsd checksum crc32 crc64 gnu hash sha1 sha2 sha3 shake sri

ddgst, dd's digest utility

ddgst is a simple hasher available cross-platform (Windows, macOS, Linux, BSDs) and comes with more features than built-in OS utilities.

Feature Comparison

Feature ddgst GNU coreutils uutils/coreutils OpenSSL [^3]
Check support ✔️ ✔️[^2] ✔️ ✔️
GNU style hashes ✔️ ✔️ ✔️[^4] ✔️
BSD style hashes ✔️ ✔️ ✔️ ✔️
SRI style hashes ✔️ [^5] [^5] [^5]

Algorithm Comparison

Checksum/Hash ddgst GNU coreutils uutils/coreutils OpenSSL[^3]
CRC-32 ✔️
CRC-64-ISO ✔️
CRC-64-ECMA ✔️
MurmurHash3 ✔️
MD5 ✔️ ✔️ ✔️ ✔️
RIPEMD-160 ✔️ ✔️ ✔️
SHA-1 ✔️ ✔️ ✔️ ✔️
SHA-2 ✔️ ✔️ ✔️ ✔️
SHA-3/SHAKE ✔️ ✔️ ✔️
BLAKE2b ✔️ ✔️ ✔️[^9] ✔️
BLAKE2s ✔️ ✔️
BLAKE3 [^6] ✔️[^9] [^8]

Algorithm Security

Checksum/Hash Type Secure
CRC-32 Checksum
CRC-64-ISO Checksum
CRC-64-ECMA Checksum
Murmurhash-32 Hash
Murmurhash-128-32 Hash
Murmurhash-128-64 Hash
MD5 Hash
RIPEMD-160 Hash ✔️
SHA-1 Hash
SHA-2 Hash ✔️
SHA-3/SHAKE Hash ✔️
BLAKE2b Hash ✔️
BLAKE2s Hash ✔️

Usage

Usage:

With no arguments, the help page is shown.

For a list of options available, use the --help argument.

For a list of supported checksums and hashes, use the --hashes switch.

Hashing files

The default mode is hashing files and directories using the GNU style.

Styles available:

Style Argument Example
GNU (default) 3853e2a78a247145b4aa16667736f6de LICENSE
BSD --tag MD5(LICENSE)= 3853e2a78a247145b4aa16667736f6de
SRI --sri md5-HSZ86zqNj3XxvjAR7ky/Uw==
Plain --plain 3853e2a78a247145b4aa16667736f6de

Check list of hashes

Check against file list (supports --tag):

$ ddgst --sha256 -c list
file1: OK
file2: FAILED
2 total: 1 mismatch, 0 not read

Using autodetection:

$ ddgst --autocheck list.sha256
file: OK
file2: FAILED
2 total: 1 mismatch, 0 not read

Check files against a hash digest

Supports hex and base64 digests.

$ ddgst --sha1 LICENSE -A f6067df486cbdbb0aac026b799b26261c92734a3
LICENSE: OK

Compare files against each other

$ ddgst --sha512 --compare LICENSE README.md dub.sdl 
Files 'LICENSE' and 'README.md' are different
Files 'README.md' and 'dub.sdl' are different
Files 'LICENSE' and 'dub.sdl' are different

Hash text entries

$ ddgst --crc32 --args "Argument with spaces" Arguments without spaces
f17cf59f  "Argument with spacesArgumentswithoutspaces"

Digest parameters

Some hashes may take optional parameters.

File Pattern Globbing (* vs. '*')

This utility supports file globbing out of the box using std.file.dirEntries.

However, while useful on Windows, most UNIX-like terminals support in-shell globbing. This may behave differently than the dirEntries function.

To force the usage of the embedded globbing mechanism, you may want to use '*' or \*. To disable it, use the -- parameter.

The globbing pattern is further explained on dlang.org.

The default parameters used in dirEntries are:

NOTE: The embedded globbing system includes hidden files.

EXAMPLE: A pattern such as src/*.{d,dd}:

Errors

Code Description
1 CLI error
2 No hashes selected or autocheck not used
3 Internal error
4 Failed to set the hash key
5 Failed to set the hash seed
6 Missing entries
9 Could not hash text argument
10 List is empty
11 Unsupported style format
15 Two or more files are required to compare

Compiling

Compiling requires a recent D compiler and DUB.

To compile a debug build with the default compiler:

dub build

Release recommendation with the LDC compiler:

dub build -b release-nobounds --compiler=ldc2

To compile with GDC, you'll also need gdmd installed.

[^2]: All but cksum and sum. [^3]: See dgst command. [^4]: * prepended to filename. [^5]: Possible to do with a chain of commands, but good luck remembering them. [^6]: While the official BLAKE3 team has a b3sum, GNU does not. [^8]: The OpenSSL team is waiting for BLAKE3 to be standardized. [^9]: As of 0.0.13