stackabletech / docker-images

Apache License 2.0
17 stars 2 forks source link

Removing MapReduce from Hadoop causes demo job to fail #793

Open maltesander opened 1 month ago

maltesander commented 1 month ago

In the hbase-hdfs-load-cycling-data we use a distcp command to copy data in the demo.

This worked prior to 24.7 release, since then we removed the map reduce component which makes this job fail.

Error: Unable to initialize main class org.apache.hadoop.tools.DistCp
Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/Job

Solution in the demo is fallback on a 24.3 image, but we need a general solution in terms of shipping with/without map reduce or provide e.g. custom images for demos.