search

koichishirahata / hadoop-gpu

Apache License 2.0
23 stars 13 forks source link

Showing the green bars in the customized web interface #1

Open ramirezaa opened 9 years ago

ramirezaa commented 9 years ago

I have succesfully ran the hadoop-gpu example programs succesfully, but I believe I am only using the CPU since when I observe at the customized web interface, I only see blue bars and not the green bars. I have include my mapred-site.xml file:

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>

 <property>
  <name>mapred.job.tracker</name>
  <value>localhost:9001</value>
 </property>

 <property>
  <name>mapred.tasktracker.map.tasks.maximum</name>
  <value>5</value>
 </property>
 <property>
  <name>mapred.tasktracker.map.cpu.tasks.maximum</name>
  <value>4</value>
 </property>
 <property>
  <name>mapred.tasktracker.map.gpu.tasks.maximum</name>
  <value>2</value>
 </property>
 <property>
  <name>mapred.tasktracker.reduce.tasks.maximum</name>
  <value>2</value>
 </property>
 <property>
  <name>mapred.reduce.tasks</name>
  <value>2</value>
 </property>

 <!-- Scheduling including GPU -->
<property>
  <name>mapred.jobtracker.map.optionalscheduling</name>
  <value>true</value>
 </property>

</configuration>

What am I doing wrong?

Thanks!

GoodCoderlord commented 9 years ago

Hello ramirezza.. Even I have faced similar issue but check your logs. It will prove you are using GPU. Another way to confirm is to run the ./kmeans2D-gpu.sh on a input. This program will run the processing on the GPU alone.

DS-UK commented 9 years ago

Hello @ramirezaa , The issue is with NVIDIA driver component not loading the kernel module. The solution is that you install nvidia-modprobe and then try running the job. I'm confident that you will see the green bars in JobTracker Web Interface.