dkangala / hamake

Automatically exported from code.google.com/p/hamake
0 stars 0 forks source link

Foreach DTR downloads mapreduce job more then once #28

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
vorl@wecho:/home/project/Fb2Pdf/src/fb2pdf/src/java$ hadoop jar lib/hamake-
2.0b-1.jar -f hamake/clusterizer.xml 
10/05/21 12:46:03 INFO hamake.Main: Using Hadoop 0.20.2+228
10/05/21 12:46:03 INFO hamake.Main: Working dir:  
file:/home/project/Fb2Pdf/src/fb2pdf/src/java
10/05/21 12:46:03 INFO hamake.Main: Reading hamake-file 
hamake/clusterizer.xml
10/05/21 12:46:04 INFO hamake.TaskRunner: Starting FB2KeywordsExtractor
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake7170202069739416701.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake3417568212133600855.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake5920122481797142662.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake6658368229370663280.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake6174639507509387716.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake2072308917826565566.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake5978274694128980024.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake1924895007165218804.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake2703470785877405170.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake3788282694965232658.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake7198400865895871074.jar
10/05/21 12:46:04 INFO hamake.Utils: Downloading 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/dist/fb2pdf.jar to 
/tmp/hamake5162972403898056358.jar
10/05/21 12:46:20 INFO hadoop.FB2KeywordsExtractor: Extracting keywords 
from 
/home/project/Fb2Pdf/src/fb2pdf/src/java/test_data/hamake/Ekzuperi_Antuan__
Malenkii_Princ_www.Litru.ru_159.fb2 to 
file:/home/project/Fb2Pdf/src/fb2pdf/src/java/build/FB2KeywordsExtractorOut
/Ekzuperi_Antuan__Malenkii_Princ_www.Litru.ru_159.fb2

Original issue reported on code.google.com by vorl.s...@gmail.com on 21 May 2010 at 9:47

GoogleCodeExporter commented 9 years ago
Jar file for a mapreduce task should be downloaded once not depending on amount 
of 
files to process

Original comment by vorl.s...@gmail.com on 21 May 2010 at 7:47

GoogleCodeExporter commented 9 years ago
what is status on this?

Original comment by kroko...@gmail.com on 27 May 2010 at 7:30

GoogleCodeExporter commented 9 years ago
I had no time for this bug. Bug is not critical and can wait while I am fixing 
other 
far more important bugs

Original comment by vorl.s...@gmail.com on 4 Jun 2010 at 1:37

GoogleCodeExporter commented 9 years ago
fixed in r347

Original comment by vorl.s...@gmail.com on 13 Jul 2010 at 8:22

GoogleCodeExporter commented 9 years ago

Original comment by vorl.s...@gmail.com on 13 Jul 2010 at 8:22