jetoile / hadoop-unit

Hadoop-Unit is a project which allow testing projects which need hadoop ecosysteme like kafka, solr, hdfs, hive, hbase, ...
https://blog.jetoile.fr/hadoop-unit/
Apache License 2.0
51 stars 15 forks source link
hadoop hadoop-unit java test

hadoop-unit

Hadoop-Unit is a project which allow testing projects which need hadoop ecosysteme like kafka, solr, hdfs, hive, hbase, ...

Moreover, it provide a standalone component which can be run locally and which simulate a hadoop cluster.

hadoop-unit-standalone: Maven Central - hadoop-unit-standalone

Build Status

For more informations, see here

Compatibility matrix

Hadoop Unit version Hadoop mini cluster version HDP version Hadoop Version
3.8 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5 + Hadoop 3.2.1
3.7 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5 + Hadoop 3.2.1
3.6 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5 + Hadoop 3.2.1
3.5 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
3.4 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
3.3 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
3.2 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
3.1 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
2.10.1 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
2.9 0.1.15 HDP 2.6.3.0 Hadoop 2.6.3
2.8 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.7 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.6 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.5 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.4 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.3 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.2 0.1.12 HDP 2.6.1.0 Hadoop 2.6.1
2.1 0.1.11 HDP 2.5.3.0 Hadoop 2.5.3
2.0 0.1.9 HDP 2.5.3.0 Hadoop 2.5.3
1.5 0.1.8 HDP 2.5.0.0 Hadoop 2.5.0
1.4 0.1.7 HDP 2.4.2.0 Hadoop 2.4.2
1.3 0.1.6 HDP 2.4.0.0 Hadoop 2.4.0
1.2 0.1.5 HDP 2.4.0.0 Hadoop 2.4.0

What is Hadoop Unit

Why Hadoop Unit

Installation

Install the standalone Hadoop Unit mode

Integrate Hadoop Unit 2.x in your maven project

Integrate Hadoop Unit 3.x in your maven project

Use CLI to operate Hadoop Unit Standalone

How to write integration test with Hadoop Unit

Why Hadoop Unit v3

Develop your own plugin

Build

Focus

FAQ

Licence