juniversalchardet is a Java port of "universalchardet", that is the encoding detector library of Mozilla.
Chinese
Cyrillic
Greek
Hebrew
Japanese
Korean
Unicode
Others
All supported encodings are listed in org.mozilla.universalchardet.Constants.
(1) Construct an instance of org.mozilla.universalchardet.UniversalDetector.
(2) Feed some data (typically some thousand bytes) to the detector
using UniversalDetector.handleData().
(3) Notify the detector of the end of data by using
UniversalDetector.dataEnd().
(4) Get the detected encoding name by using
UniversalDetector.getDetectedCharset().
(5) Don't forget to call UniversalDetector.reset() before you reuse
the detector instance for another guess.
------------ Sample Code ------------
import org.mozilla.universalchardet.UniversalDetector;
public class TestDetector
{
public static void main(String[] args)
{
byte[] buf = new byte[4096];
java.io.InputStream fis = java.nio.file.Files.newInputStream(java.nio.file.Paths.get("test.txt"));
// (1)
UniversalDetector detector = new UniversalDetector();
// (2)
int nread;
while ((nread = fis.read(buf)) > 0 && !detector.isDone()) {
detector.handleData(buf, 0, nread);
}
// (3)
detector.dataEnd();
// (4)
String encoding = detector.getDetectedCharset();
if (encoding != null) {
System.out.println("Detected encoding = " + encoding);
} else {
System.out.println("No encoding detected.");
}
// (5)
detector.reset();
}
}
import org.mozilla.universalchardet.UniversalDetector;
public class TestDetectorFile {
public static void main (String[] args) throws java.io.IOException {
if (args.length != 1) {
System.err.println("Usage: java TestDetectorFile FILENAME");
System.exit(1);
}
java.io.File file = new java.io.File(args[0]);
String encoding = UniversalDetector.detectCharset(file);
if (encoding != null) {
System.out.println("Detected encoding = " + encoding);
} else {
System.out.println("No encoding detected.");
}
}
}
import org.mozilla.universalchardet.ReaderFactory;
public class TestCreateReaderFromFile {
public static void main (String[] args) throws java.io.IOException {
if (args.length != 1) {
System.err.println("Usage: java TestCreateReaderFromFile FILENAME");
System.exit(1);
}
java.io.Reader reader = null;
try {
java.io.File file = new java.io.File(args[0]);
reader = ReaderFactory.createBufferedReader(file);
// Do whatever you want with the reader
}
finally {
if (reader != null) {
reader.close();
}
}
}
}
Put this dependency in your pom.xml
<dependency>
<groupId>com.github.albfernandez</groupId>
<artifactId>juniversalchardet</artifactId>
<version>2.4.0</version>
</dependency>
Put this line in your build.gradle
implementation 'com.github.albfernandez:juniversalchardet:2.4.0' git clone https://github.com/albfernandez/juniversalchardet.git
cd juniversalchardet
mvn clean packagejchardet is another Java port of the Mozilla's encoding dectection library. The main difference between jchardet and juniversalchardet is modules they are based on. jchardet is based on the "chardet" module that has long existed. juniversalchardet is based on the "universalchardet" module that is new and generally provides better accuracy on detection results.
The original repository of this project
The library is subject to the Mozilla Public License Version 1.1.
Alternatively, the library may be used under the terms of either the GNU General Public License Version 2 or later, or the GNU Lesser General Public License 2.1 or later.
juniversalchardet requires JDK 7 or higher.
For Android: