looks for abc.<hivetable>

I have created external table ext_test_data and using the windowing function and i get following error. It looks for abc.ext_test_data? Why does it default to abc? i tried with databasename.tablename but that didn't work either

hive> from ext_test_data

partition by acc_id order by acc_id,upd_dt desc with first_value(upd_dt, 'true') over rows between current row and 1 following as eff_end_dt select acc_id,acc_name,upd_dt,eff_end_dt; com.sap.hadoop.windowing.WindowingException: com.sap.hadoop.windowing.WindowingException: NoSuchObjectException(message:abc.ext_test_data table not found) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:77)

Rohit

The issue is with support for non default databases. Just checked in a partial fix, commit c41d8a4f4ae3477699039ed901deeb5498fbcbd2 You will have to pull from source and do a local build. I will upload a new version in a couple of weeks.

You will have to do something like this:

wmode hive; use dbname; wmode windowing; from ext_test_data partition by acc_id order by acc_id,upd_dt desc with first_value(upd_dt, 'true') over rows between current row and 1 following as eff_end_dt select acc_id,acc_name,upd_dt,eff_end_dt;

So the windowing query now reacts to the db set in the hive session. This is only a partial fix, the complete fix requires allowing the table to be qualified by the dbname in the WIndowing Query.

What are the steps for doing local build? I could not find in documentation?

Rohit

Using eclipse i tried building and i get following errors

Tests in error: com.sap.hadoop.windowing.census.CensusTest com.sap.hadoop.windowing.flightsdata.FlightsTest test1(com.sap.hadoop.windowing.functions.FloatTest) testLag(com.sap.hadoop.windowing.functions.LeadLagTest) testLead(com.sap.hadoop.windowing.functions.LeadLagTest) testLag2(com.sap.hadoop.windowing.functions.LeadLagTest) testLead2(com.sap.hadoop.windowing.functions.LeadLagTest) test1(com.sap.hadoop.windowing.functions.NPathTest) testPlus(com.sap.hadoop.windowing.functions.NPathTest) testStar(com.sap.hadoop.windowing.functions.NPathTest) test1(com.sap.hadoop.windowing.functions.RankingTest) testNtile(com.sap.hadoop.windowing.functions.RankingTest) testVariance(com.sap.hadoop.windowing.functions.StatisticsTest) testCoVariance(com.sap.hadoop.windowing.functions.StatisticsTest) testLinearReg(com.sap.hadoop.windowing.functions.StatisticsTest) testLinearReg2(com.sap.hadoop.windowing.functions.StatisticsTest) test1(com.sap.hadoop.windowing.functions.TableFuncTest) testFuncChain(com.sap.hadoop.windowing.functions.TableFuncTest) testWithClauseCheck(com.sap.hadoop.windowing.functions.TableFuncTest) com.sap.hadoop.windowing.query.QueryComponentizerTest test1(com.sap.hadoop.windowing.runtime.CompositeDataTypesTest) testLag(com.sap.hadoop.windowing.runtime.LargePartitionTest) com.sap.hadoop.windowing.runtime.mr.CompositeDataTypeMRTest com.sap.hadoop.windowing.runtime.mr.EmbeddedHiveQueryTest com.sap.hadoop.windowing.runtime.mr.FunctionChainTest com.sap.hadoop.windowing.runtime.mr.IssuesTest com.sap.hadoop.windowing.runtime.mr.MRTest com.sap.hadoop.windowing.runtime.mr.MRTranslationTest com.sap.hadoop.windowing.runtime.mr.MultipleDBTest com.sap.hadoop.windowing.runtime.mr.OrderingTest com.sap.hadoop.windowing.runtime.mr.OutputToTableTest com.sap.hadoop.windowing.runtime.mr.RCFileTest com.sap.hadoop.windowing.runtime.mr.TableFunctionTest test1(com.sap.hadoop.windowing.runtime.mr.WhereClauseTest) test2(com.sap.hadoop.windowing.runtime.mr.WhereClauseTest)

Tests run: 88, Failures: 0, Errors: 35, Skipped: 0

[INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:42.911s [INFO] Finished at: Wed May 16 09:38:20 GMT+05:30 2012 [INFO] Final Memory: 37M/81M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.7.1:test (default-test) on project com.sap.hadoop.windowing: There are test failures. [ERROR] [ERROR] Please refer to /RohitPersonal/hive/hbutani-SQLWindowing-c471466/windowing/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

Almost all test gives following error messages

Test set: com.sap.hadoop.windowing.functions.TableFuncTest

Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 0.539 sec <<< FAILURE! test1(com.sap.hadoop.windowing.functions.TableFuncTest) Time elapsed: 0.161 sec <<< ERROR! org.apache.hadoop.hive.serde2.SerDeException: class org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe: expects either BytesWritable or Text object! at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.deserialize(LazySimpleSerDe.java:309) at org.apache.hadoop.hive.serde2.Deserializer$deserialize.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)

You need to update MRBaseTest based on your local env. Also you need to have all the tables referenced in the tests loaded in your local env. If you don't want to setup a local dev env, try mvn install -DskipTests

Yeah i skipped the test and built the jar. Why is it must to have output path? What if i want it on screen ?

hive> from ext_test_data

partition by acc_id order by acc_id,upd_dt desc with first_value(upd_dt, 'true') over rows between current row and 1 following as eff_end_dt select acc_id,acc_name,upd_dt,eff_end_dt ; com.sap.hadoop.windowing.WindowingException: com.sap.hadoop.windowing.WindowingException: Query doesn't contain an output Path for results at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513)

from ext_test_data partition by acc_id order by acc_id,upd_dt desc with first_value(upd_dt, 'true') over rows between current row and 1 following as eff_end_dt select acc_id,acc_name,upd_dt,eff_end_dt into path='/tmp/wout';

I see the directory /tmp/wout is created but job fails with following error Hadoop job information for : number of mappers: 1; number of reducers: 1 2012-05-16 04:48:49,369 map = 0%, reduce = 0% 2012-05-16 04:48:57,424 map = 100%, reduce = 100% Map: 1 Reduce: 1 HDFS Read: 0 HDFS Write: 0 FAIL Ended Job = job_201205110450_1928 with errors: # of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201205110450_1928_m_000000

Error initializing attempt_201205110450_1928_m_000000_0: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid local directory for taskTracker/edwprod/jobcache/job_201205110450_1928/attempt_201205110450_1928_m_000000_0/split.info at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:381) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:146) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:127) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:111) at org.apache.hadoop.mapred.MapTask.localizeConfiguration(MapTask.java:122) at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:2538) at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:2598) at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:1294) at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2363) at java.lang.Thread.run(Thread.java:619)

Yes, I haven't gotten around to adding support for output to the console.

The error seems to imply an hdfs error; DiskChecker error could imply you have run out of disk space. Can you paste the Task logs

I have pasted task log too. Also, there is no disk space issue.

Rohit

Hi,

Here's the content of the table hive> select * from ext_test_data; OK 123 Rohit 20120515 123 Kshitiz 20120511 123 Satya 20120505 456 Ajay 20120514 456 Sharma 20120510 Time taken: 0.297 seconds

Looking at logs it seems it is running beyond memory limits which is very unusual. Could there be memory leak happening in windowing code? TaskTree [pid=30494,tipID=attempt_201205110450_1937_m_000002_0] is running beyond memory-limits. Current usage : 2324144128bytes. Limit : 1610612736bytes. Killing task. TaskTree [pid=30494,tipID=attempt_201205110450_1937_m_000002_0] is running beyond memory-limits. Current usage : 2324144128bytes. Limit : 1610612736bytes. Killing task. Dump of the process-tree for attempt_201205110450_1937_m_000002_0 : |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE |- 30494 12452 30494 30494 (java) 348 21 2324144128 14624 /home/Releases/gridjdk-1.6.0_21.1011192346-20110412-000/share/gridjdk-1.6.0_21/jre/bin/java -Djava.library.path=/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/native/Linux-i386-32:/grid/2/tmp/mapred-local/taskTracker/edwprod/jobcache/job_201205110450_1937/attempt_201205110450_1937_m_000002_0/work -Xmx2048m -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Djava.io.tmpdir=/grid/2/tmp/mapred-local/taskTracker/edwprod/jobcache/job_201205110450_1937/attempt_201205110450_1937_m_000002_0/work/tmp -classpath /home/gs/conf/hadoop/datanode:/home/gs/java/jdk/lib/tools.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/..:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../hadoop-core-0.20.205.0.4.1202122302.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/asm-3.2.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/aspectjrt-1.6.5.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/aspectjtools-1.6.5.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/axis.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/bouncer_auth_java-0.5.12.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/BouncerFilterAuth-1.1.4.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-beanutils-1.7.0.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-beanutils-core-1.8.0.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-cli-1.2.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-codec-1.4.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-collections-3.2.1.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-configuration-1.6.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-daemon-1.0.1.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-digester-1.8.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-el-1.0.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-httpclient-3.0.1.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-lang-2.4.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-logging-1.1.1.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-logging-api-1.0.4.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-math-2.1.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/commons-net-1.4.1.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/core-3.1.1.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-000/share/hadoop-0.20.205.0.4.1202122302/libexec/../lib/hadoop-capacity-scheduler-0.20.205.0.4.1202122302.jar:/home/Releases/hadoop-0.20.205.0.4.1202122302-20120327-

if you online, you can ping me at rohitchattar@yahoo.com Yahoo messenger Rohit

Hmm. I don't see the whole log file in the issue comment. Can you email it to me: rhbutani@gmail.com We can chat today/tonight.

We are getting similar issues on Cloudera CHD3u3:

Simple Query:

from < select uuid from events > partition by uuid order by uuid with count('uuid') as uuid_cnt select uuid, uuid_cnt into path='/user/hadoop/wout';

Results:

Executing Embedded Hive Query: Create table WindowingTempTable_1344023678588 as select uuid from events

Total MapReduce jobs = 2 Launching Job 1 out of 2 Number of reduce tasks is set to 0 since there's no reduce operator Starting Job = job_201208031236_0009, Tracking URL = http://hive1:50030/jobdetails.jsp?jobid=job_201208031236_0009 Kill Command = /usr/lib/hadoop/bin/hadoop job -Dmapred.job.tracker=hive1:41211 -kill job_201208031236_0009 2012-08-03 12:54:47,469 Stage-1 map = 0%, reduce = 0% 2012-08-03 12:54:49,698 Stage-1 map = 100%, reduce = 100% Ended Job = job_201208031236_0009 Ended Job = -101210544, job is filtered out (removed at runtime). Moving data to: hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_12-54-38_596_5794643045673443289/-ext-10001 Moving data to: hdfs://hive1:41210/user/hive/warehouse/analytics.db/windowingtemptable_1344023678588 8 Rows loaded to hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_12-54-38_596_5794643045673443289/-ext-10000 OK Time taken: 11.422 seconds Finished Executing Embedded Hive Query

Starting Job = job_201208031236_0010, Tracking URL = http://hive1:50030/jobdetails.jsp?jobid=job_201208031236_0010 Kill Command = /usr/lib/hadoop/bin/hadoop job -Dmapred.job.tracker=hive1:41211 -kill job_201208031236_0010 Hadoop job information for : number of mappers: 2; number of reducers: 1 2012-08-03 12:55:08,443 map = 100%, reduce = 100% Map: 2 Reduce: 1 HDFS Read: 0 HDFS Write: 0 FAIL Ended Job = job_201208031236_0010 with errors: NA Executing Embedded Hive Query: drop table WindowingTempTable_1344023678588

OK Time taken: 0.565 seconds Finished Executing Embedded Hive Query

hive.log: 2012-08-03 13:52:00,444 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved. 2012-08-03 13:52:00,444 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved. 2012-08-03 13:52:00,446 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved. 2012-08-03 13:52:00,446 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved. 2012-08-03 13:52:00,447 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved. 2012-08-03 13:52:00,447 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved. 2012-08-03 13:52:22,265 WARN mapred.JobClient (JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 2012-08-03 13:52:22,709 WARN snappy.LoadSnappy (LoadSnappy.java:(36)) - Snappy native library is available 2012-08-03 13:53:03,739 WARN mapred.JobClient (JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 2012-08-03 13:53:19,351 ERROR mr.WindowingJobTracker (SessionState.java:printError(365)) - Ended Job = job_201208031236_0026 with errors: NA

Anything in the Task log files?

Thanks btw, any help would be very much appreciated, looking forward to getting this working and contributing on future plans if needed.

Tasktracker Logs:

... 12/08/03 14:37:43 WARN conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0035/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 12/08/03 14:37:43 WARN mapred.DefaultTaskController: Exit code from task is : 1 12/08/03 14:37:43 WARN mapred.TaskRunner: attempt_201208031236_0035_m_000003_0 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) 12/08/03 14:37:47 WARN mapred.DefaultTaskController: Exit code from task is : 1 12/08/03 14:37:47 WARN mapred.TaskRunner: attempt_201208031236_0035_m_000003_1 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) 12/08/03 14:37:50 WARN mapred.DefaultTaskController: Exit code from task is : 1 12/08/03 14:37:50 WARN mapred.TaskRunner: attempt_201208031236_0035_m_000002_0 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) 12/08/03 14:37:53 WARN mapred.DefaultTaskController: Exit code from task is : 1 12/08/03 14:37:53 WARN mapred.TaskRunner: attempt_201208031236_0035_m_000002_1 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229)

Job Attempt Syslog:

2012-08-03 14:05:04,913 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/job.xml:a attempt to override final parameter: mapred.system.dir; Ignoring. 2012-08-03 14:05:04,921 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_2012080312360031/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring. 2012-08-03 14:05:04,969 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2012-08-03 14:05:06,158 INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: /hadoop-default/mapred/taskTracker/distcache/-8128760768693284107-312610165_1850613907/hive1/tmp/hive-hadoop/hive_2012-08-03_14-04-51_911_518344306125677299/-mr-10003/7577c9fd-7868-433f-8245-c36b95fe18ca <- /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/attempt_201208031236_0031_r_000000_0/work/HIVE_PLAN7577c9fd-7868-433f-8245-c36b95fe18ca 2012-08-03 14:05:06,233 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/jars/.job.jar.crc <- /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/attempt_201208031236_0031_r_000000_0/work/.job.jar.crc 2012-08-03 14:05:06,235 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/jars/job.jar <- /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/attempt_201208031236_0031_r_000000_0/work/job.jar 2012-08-03 14:05:06,309 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId= 2012-08-03 14:05:06,458 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/job.xml:a attempt to override final parameter: mapred.system.dir; Ignoring. 2012-08-03 14:05:06,459 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring. 2012-08-03 14:05:06,459 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 2012-08-03 14:05:06,615 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit code 0 2012-08-03 14:05:06,620 INFO org.apache.hadoop.mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@71f1235b 2012-08-03 14:05:06,800 WARN org.apache.hadoop.io.compress.snappy.LoadSnappy: Snappy native library is available 2012-08-03 14:05:06,800 INFO org.apache.hadoop.io.compress.snappy.LoadSnappy: Snappy native library loaded 2012-08-03 14:05:06,827 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=141937872, MaxSingleShuffleLimit=35484468 2012-08-03 14:05:06,888 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2012-08-03 14:05:06,894 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2012-08-03 14:05:06,906 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201208031236_0031_r_000000_0 Thread started: Thread for merging on-disk files 2012-08-03 14:05:06,906 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201208031236_0031_r_000000_0 Thread waiting: Thread for merging on-disk files 2012-08-03 14:05:06,910 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201208031236_0031_r_000000_0 Thread started: Thread for merging in memory files 2012-08-03 14:05:06,910 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201208031236_0031_r_000000_0 Need another 1 map output(s) where 0 is already in progress 2012-08-03 14:05:06,919 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201208031236_0031_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2012-08-03 14:05:06,920 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201208031236_0031_r_000000_0 Thread started: Thread for polling Map Completion Events 2012-08-03 14:05:11,925 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201208031236_0031_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2012-08-03 14:05:14,558 INFO org.apache.hadoop.mapred.ReduceTask: GetMapEventsThread exiting 2012-08-03 14:05:14,558 INFO org.apache.hadoop.mapred.ReduceTask: getMapsEventsThread joined. 2012-08-03 14:05:14,559 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager 2012-08-03 14:05:14,559 INFO org.apache.hadoop.mapred.ReduceTask: Interleaved on-disk merge complete: 0 files left. 2012-08-03 14:05:14,559 INFO org.apache.hadoop.mapred.ReduceTask: In-memory merge complete: 1 files left. 2012-08-03 14:05:14,576 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments 2012-08-03 14:05:14,576 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 167 bytes 2012-08-03 14:05:14,582 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor 2012-08-03 14:05:14,588 INFO org.apache.hadoop.mapred.ReduceTask: Merged 1 segments, 167 bytes to disk to satisfy reduce memory limit 2012-08-03 14:05:14,588 INFO org.apache.hadoop.mapred.ReduceTask: Merging 1 files, 181 bytes from disk 2012-08-03 14:05:14,589 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce 2012-08-03 14:05:14,589 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments 2012-08-03 14:05:14,602 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 177 bytes 2012-08-03 14:05:14,612 INFO ExecReducer: maximum memory = 202768384 2012-08-03 14:05:14,612 INFO ExecReducer: conf classpath = [file:/hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/jars/classes, file:/hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/jars/, file:/hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/attempt_201208031236_0031_r_000000_0/] 2012-08-03 14:05:14,612 INFO ExecReducer: thread classpath = [file:/etc/hadoop-0.20/conf.analytics/, file:/opt/jdk1.6.0_31/lib/tools.jar, file:/usr/lib/hadoop-0.20/, file:/usr/lib/hadoop-0.20/hadoop-core-0.20.2-cdh3u3.jar, file:/usr/lib/hadoop-0.20/lib/ant-contrib-1.0b3.jar, file:/usr/lib/hadoop-0.20/lib/aspectjrt-1.6.5.jar, file:/usr/lib/hadoop-0.20/lib/aspectjtools-1.6.5.jar, file:/usr/lib/hadoop-0.20/lib/commons-cli-1.2.jar, file:/usr/lib/hadoop-0.20/lib/commons-codec-1.4.jar, file:/usr/lib/hadoop-0.20/lib/commons-daemon-1.0.1.jar, file:/usr/lib/hadoop-0.20/lib/commons-el-1.0.jar, file:/usr/lib/hadoop-0.20/lib/commons-httpclient-3.1.jar, file:/usr/lib/hadoop-0.20/lib/commons-lang-2.4.jar, file:/usr/lib/hadoop-0.20/lib/commons-logging-1.0.4.jar, file:/usr/lib/hadoop-0.20/lib/commons-logging-api-1.0.4.jar, file:/usr/lib/hadoop-0.20/lib/commons-net-1.4.1.jar, file:/usr/lib/hadoop-0.20/lib/core-3.1.1.jar, file:/usr/lib/hadoop-0.20/lib/guava-r09-jarjar.jar, file:/usr/lib/hadoop-0.20/lib/hadoop-fairscheduler-0.20.2-cdh3u3.jar, file:/usr/lib/hadoop-0.20/lib/hadoop-lzo-0.4.17-SNAPSHOT.jar, file:/usr/lib/hadoop-0.20/lib/hsqldb-1.8.0.10.jar, file:/usr/lib/hadoop-0.20/lib/jackson-core-asl-1.5.2.jar, file:/usr/lib/hadoop-0.20/lib/jackson-mapper-asl-1.5.2.jar, file:/usr/lib/hadoop-0.20/lib/jasper-compiler-5.5.12.jar, file:/usr/lib/hadoop-0.20/lib/jasper-runtime-5.5.12.jar, file:/usr/lib/hadoop-0.20/lib/jets3t-0.6.1.jar, file:/usr/lib/hadoop-0.20/lib/jetty-6.1.26.cloudera.1.jar, file:/usr/lib/hadoop-0.20/lib/jetty-servlet-tester-6.1.26.cloudera.1.jar, file:/usr/lib/hadoop-0.20/lib/jetty-util-6.1.26.cloudera.1.jar, file:/usr/lib/hadoop-0.20/lib/jsch-0.1.42.jar, file:/usr/lib/hadoop-0.20/lib/junit-4.5.jar, file:/usr/lib/hadoop-0.20/lib/kfs-0.2.2.jar, file:/usr/lib/hadoop-0.20/lib/log4j-1.2.15.jar, file:/usr/lib/hadoop-0.20/lib/mockito-all-1.8.2.jar, file:/usr/lib/hadoop-0.20/lib/oro-2.0.8.jar, file:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-20081211.jar, file:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-6.1.14.jar, file:/usr/lib/hadoop-0.20/lib/slf4j-api-1.4.3.jar, file:/usr/lib/hadoop-0.20/lib/slf4j-log4j12-1.4.3.jar, file:/usr/lib/hadoop-0.20/lib/xmlenc-0.52.jar, file:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-2.1.jar, file:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-api-2.1.jar, file:/hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/jars/classes, file:/hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/jars/job.jar, file:/hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031236_0031/attempt_201208031236_0031_r_000000_0/work/] 2012-08-03 14:05:15,203 INFO ExecReducer:

Id =4 Id =5 Id =6 Id = 5 null<\Parent> <\FS> <\Children> Id = 4 null<\Parent> <\SEL> <\Children> <\GBY> 2012-08-03 14:05:15,203 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: Initializing Self 4 GBY 2012-08-03 14:05:15,212 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: Operator 4 GBY initialized 2012-08-03 14:05:15,213 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: Initializing children of 4 GBY 2012-08-03 14:05:15,213 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing child 5 SEL 2012-08-03 14:05:15,213 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing Self 5 SEL 2012-08-03 14:05:15,213 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: SELECT struct<_col0:string,_col1:bigint> 2012-08-03 14:05:15,213 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Operator 5 SEL initialized 2012-08-03 14:05:15,213 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing children of 5 SEL 2012-08-03 14:05:15,213 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initializing child 6 FS 2012-08-03 14:05:15,213 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initializing Self 6 FS 2012-08-03 14:05:15,274 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Operator 6 FS initialized 2012-08-03 14:05:15,274 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initialization Done 6 FS 2012-08-03 14:05:15,274 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initialization Done 5 SEL 2012-08-03 14:05:15,274 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: Initialization Done 4 GBY 2012-08-03 14:05:15,278 INFO ExecReducer: ExecReducer: processing 1 rows: used memory = 9809520 2012-08-03 14:05:15,279 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: 4 forwarding 1 rows 2012-08-03 14:05:15,279 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 5 forwarding 1 rows 2012-08-03 14:05:15,279 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Final Path: FS hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_14-04-51_911_518344306125677299/_tmp.-ext-10001/000000_0 2012-08-03 14:05:15,280 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Writing to temp file: FS hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_14-04-51_911_518344306125677299/_tmp.-ext-10001/_tmp.000000_0 2012-08-03 14:05:15,310 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: New Final Path: FS hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_14-04-51_911_518344306125677299/_tmp.-ext-10001/000000_0 2012-08-03 14:05:15,357 INFO ExecReducer: ExecReducer: processed 3 rows: used memory = 11070192 2012-08-03 14:05:15,358 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: 4 finished. closing... 2012-08-03 14:05:15,358 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: 4 forwarded 2 rows 2012-08-03 14:05:15,358 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 5 finished. closing... 2012-08-03 14:05:15,358 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 5 forwarded 3 rows 2012-08-03 14:05:15,358 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: 6 finished. closing... 2012-08-03 14:05:15,358 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: 6 forwarded 0 rows 2012-08-03 14:05:15,568 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 5 Close done 2012-08-03 14:05:15,568 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: 4 Close done 2012-08-03 14:05:15,568 INFO org.apache.hadoop.mapred.Task: Task:attempt_201208031236_0031_r_000000_0 is done. And is in the process of commiting 2012-08-03 14:05:15,626 INFO org.apache.hadoop.mapred.Task: Task 'attempt_201208031236_0031_r_000000_0' done. 2012-08-03 14:05:15,630 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1

Tasktracker Log (Logging turned up to INFO):

2012-08-03 14:47:40,753 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201208031444_0001_m_000002_0 task's state:UNASSIGNED 2012-08-03 14:47:40,765 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201208031444_0001_m_000002_0 which needs 1 slots 2012-08-03 14:47:40,765 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201208031444_0001_m_000002_0 which needs 1 slots 2012-08-03 14:47:41,108 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: mapred.system.dir; Ignoring. 2012-08-03 14:47:41,109 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring. 2012-08-03 14:47:41,109 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 2012-08-03 14:47:41,174 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating f0d50be1-dee6-4ac1-83ca-8898cff578e1 in /hadoop-default/mapred/taskTracker/distcache/4425470487044516551_1214699689_1853177759/hive1/tmp/hive-hadoop/hive_2012-08-03_14-47-35_812_4894441392788894923/-mr-10004-work-8798430260226069379 with rwxr-xr-x 2012-08-03 14:47:41,187 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Cached hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_14-47-35_812_4894441392788894923/-mr-10004/f0d50be1-dee6-4ac1-83ca-8898cff578e1#HIVE_PLANf0d50be1-dee6-4ac1-83ca-8898cff578e1 as /hadoop-default/mapred/taskTracker/distcache/4425470487044516551_1214699689_1853177759/hive1/tmp/hive-hadoop/hive_2012-08-03_14-47-35_812_4894441392788894923/-mr-10004/f0d50be1-dee6-4ac1-83ca-8898cff578e1 2012-08-03 14:47:41,188 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Cached hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_14-47-35_812_4894441392788894923/-mr-10004/f0d50be1-dee6-4ac1-83ca-8898cff578e1#HIVE_PLANf0d50be1-dee6-4ac1-83ca-8898cff578e1 as /hadoop-default/mapred/taskTracker/distcache/4425470487044516551_1214699689_1853177759/hive1/tmp/hive-hadoop/hive_2012-08-03_14-47-35_812_4894441392788894923/-mr-10004/f0d50be1-dee6-4ac1-83ca-8898cff578e1 2012-08-03 14:47:41,424 INFO org.apache.hadoop.mapred.JobLocalizer: Initializing user hadoop on this TT. 2012-08-03 14:47:41,668 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: mapred.system.dir; Ignoring. 2012-08-03 14:47:41,669 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring. 2012-08-03 14:47:41,674 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 2012-08-03 14:47:42,386 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: mapred.system.dir; Ignoring. 2012-08-03 14:47:42,387 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring. 2012-08-03 14:47:42,388 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031444_0001/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 2012-08-03 14:47:42,537 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201208031444_0001m-2024557006 2012-08-03 14:47:42,537 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201208031444_0001m-2024557006 spawned. 2012-08-03 14:47:42,541 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0001/attempt_201208031444_0001_m_000002_0/taskjvm.sh 2012-08-03 14:47:45,297 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201208031444_0001m-2024557006 given task: attempt_201208031444_0001_m_000002_0 2012-08-03 14:47:48,124 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201208031444_0001_m_000002_0 0.0% setup 2012-08-03 14:47:48,126 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201208031444_0001_m_000002_0 is done. 2012-08-03 14:47:48,126 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201208031444_0001_m_000002_0 was -1 2012-08-03 14:47:48,127 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1 2012-08-03 14:47:48,350 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201208031444_0001_m_000000_0 task's state:UNASSIGNED 2012-08-03 14:47:48,430 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201208031444_0001_m_000000_0 which needs 1 slots 2012-08-03 14:47:48,430 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201208031444_0001_m_000000_0 which needs 1 slots 2012-08-03 14:47:48,431 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201208031444_0001_m_000002_0 2012-08-03 14:47:48,431 INFO org.apache.hadoop.mapred.TaskTracker: About to purge task: attempt_201208031444_0001_m_000002_0 2012-08-03 14:47:48,432 INFO org.apache.hadoop.mapred.IndexCache: Map ID attempt_201208031444_0001_m_000002_0 not found in cache 2012-08-03 14:47:48,653 INFO org.apache.hadoop.mapred.JvmManager: No new JVM spawned for jobId/taskid: job_201208031444_0001/attempt_201208031444_0001_m_000000_0. Attempting to reuse: jvm_201208031444_0001m-2024557006 2012-08-03 14:47:49,158 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201208031444_0001m-2024557006 given task: attempt_201208031444_0001_m_000000_0 2012-08-03 14:47:50,260 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201208031444_0001_m_000000_0 1.0% /user/hive/warehouse/analytics.db/testtable/000000_0:0+336 2012-08-03 14:47:50,262 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201208031444_0001_m_000000_0 is done. 2012-08-03 14:47:50,262 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201208031444_0001_m_000000_0 was -1 2012-08-03 14:47:50,263 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1 2012-08-03 14:47:50,532 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201208031444_0001_m_000001_0 task's state:UNASSIGNED 2012-08-03 14:47:50,532 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201208031444_0001_m_000001_0 which needs 1 slots 2012-08-03 14:47:50,532 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201208031444_0001_m_000001_0 which needs 1 slots 2012-08-03 14:47:50,561 INFO org.apache.hadoop.mapred.JvmManager: No new JVM spawned for jobId/taskid: job_201208031444_0001/attempt_201208031444_0001_m_000001_0. Attempting to reuse: jvm_201208031444_0001m-2024557006 2012-08-03 14:47:50,775 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201208031444_0001m-2024557006 given task: attempt_201208031444_0001_m_000001_0 2012-08-03 14:47:50,883 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201208031444_0001_m_000001_0 0.0% 2012-08-03 14:47:50,913 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201208031444_0001_m_000001_0 0.0% cleanup 2012-08-03 14:47:50,915 INFO org.apache.hadoop.mapred.TaskTracker: Task attempt_201208031444_0001_m_000001_0 is done. 2012-08-03 14:47:50,915 INFO org.apache.hadoop.mapred.TaskTracker: reported output size for attempt_201208031444_0001_m_000001_0 was -1 2012-08-03 14:47:50,915 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1 2012-08-03 14:47:51,363 INFO org.apache.hadoop.mapred.TaskTracker: Received 'KillJobAction' for job: job_201208031444_0001 2012-08-03 14:47:51,363 INFO org.apache.hadoop.mapred.IndexCache: Map ID attempt_201208031444_0001_m_000001_0 not found in cache 2012-08-03 14:47:51,364 INFO org.apache.hadoop.mapred.IndexCache: Map ID attempt_201208031444_0001_m_000000_0 not found in cache 2012-08-03 14:47:51,431 INFO org.apache.hadoop.mapred.TaskTracker: Killing JVM jvm_201208031444_0001m-2024557006 since job job_201208031444_0001 is dead 2012-08-03 14:47:51,482 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201208031444_0001 for user-log deletion with retainTimeStamp:1344116871364 2012-08-03 14:47:51,528 INFO org.apache.hadoop.util.ProcessTree: Killing process group25528 with signal TERM. Exit code 0 2012-08-03 14:47:51,885 WARN org.apache.hadoop.mapred.DefaultTaskController: Exit code from task is : 143 2012-08-03 14:47:51,886 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201208031444_0001m-2024557006 exited with exit code 143. Number of tasks it ran: 3 2012-08-03 14:47:58,585 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201208031444_0002_m_000003_0 task's state:UNASSIGNED 2012-08-03 14:47:58,586 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201208031444_0002_m_000003_0 which needs 1 slots 2012-08-03 14:47:58,586 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201208031444_0002_m_000003_0 which needs 1 slots 2012-08-03 14:47:58,666 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: mapred.system.dir; Ignoring. 2012-08-03 14:47:58,666 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring. 2012-08-03 14:47:58,667 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 2012-08-03 14:47:58,685 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating querySpec in /hadoop-default/mapred/taskTracker/distcache/7008747313699011628_2136978784_1853195532/hive1/tmp/hive-hadoop/windowing/windowingJob--294288992-work--2528181431900020600 with rwxr-xr-x 2012-08-03 14:47:58,704 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Cached hdfs://hive1:41210/tmp/hive-hadoop/windowing/windowingJob--294288992/querySpec#WINDOWING_QUERY as /hadoop-default/mapred/taskTracker/distcache/7008747313699011628_2136978784_1853195532/hive1/tmp/hive-hadoop/windowing/windowingJob--294288992/querySpec 2012-08-03 14:47:58,705 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Cached hdfs://hive1:41210/tmp/hive-hadoop/windowing/windowingJob--294288992/querySpec#WINDOWING_QUERY as /hadoop-default/mapred/taskTracker/distcache/7008747313699011628_2136978784_1853195532/hive1/tmp/hive-hadoop/windowing/windowingJob--294288992/querySpec 2012-08-03 14:47:58,744 INFO org.apache.hadoop.mapred.JobLocalizer: Initializing user hadoop on this TT. 2012-08-03 14:47:58,788 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: mapred.system.dir; Ignoring. 2012-08-03 14:47:58,788 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring. 2012-08-03 14:47:58,789 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 2012-08-03 14:47:59,374 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating hive-exec-0.7.1-cdh3u3.jar in /hadoop-default/mapred/taskTracker/hadoop/distcache/-1813060006758195120_1921473401_1853197683/hive1/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_201208031444_0002/libjars-work-3767752949000185334 with rwxr-xr-x 2012-08-03 14:47:59,624 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Cached hdfs://hive1:41210/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_201208031444_0002/libjars/hive-exec-0.7.1-cdh3u3.jar as /hadoop-default/mapred/taskTracker/hadoop/distcache/-1813060006758195120_1921473401_1853197683/hive1/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_2012080314440002/libjars/hive-exec-0.7.1-cdh3u3.jar 2012-08-03 14:47:59,627 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating hive-contrib-0.7.1-cdh3u3.jar in /hadoop-default/mapred/taskTracker/hadoop/distcache/492717983420196115-1600713953_1853197831/hive1/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_201208031444_0002/libjars-work-4834903565799106083 with rwxr-xr-x 2012-08-03 14:47:59,657 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Cached hdfs://hive1:41210/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_2012080314440002/libjars/hive-contrib-0.7.1-cdh3u3.jar as /hadoop-default/mapred/taskTracker/hadoop/distcache/492717983420196115-1600713953_1853197831/hive1/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_2012080314440002/libjars/hive-contrib-0.7.1-cdh3u3.jar 2012-08-03 14:47:59,659 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating groovy-all-1.8.0.jar in /hadoop-default/mapred/taskTracker/hadoop/distcache/-5867685467111976746-1040170175_1853197871/hive1/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_201208031444_0002/libjars-work--3478165415187314887 with rwxr-xr-x 2012-08-03 14:47:59,745 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Cached hdfs://hive1:41210/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_2012080314440002/libjars/groovy-all-1.8.0.jar as /hadoop-default/mapred/taskTracker/hadoop/distcache/-5867685467111976746-1040170175_1853197871/hive1/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_2012080314440002/libjars/groovy-all-1.8.0.jar 2012-08-03 14:47:59,749 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating hive-metastore-0.7.1-cdh3u3.jar in /hadoop-default/mapred/taskTracker/hadoop/distcache/1792907858821577362-289356670_1853198109/hive1/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_201208031444_0002/libjars-work--1715575608691359506 with rwxr-xr-x 2012-08-03 14:47:59,789 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Cached hdfs://hive1:41210/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_2012080314440002/libjars/hive-metastore-0.7.1-cdh3u3.jar as /hadoop-default/mapred/taskTracker/hadoop/distcache/1792907858821577362-289356670_1853198109/hive1/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_201208031444_0002/libjars/hive-metastore-0.7.1-cdh3u3.jar 2012-08-03 14:47:59,845 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: mapred.system.dir; Ignoring. 2012-08-03 14:47:59,845 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring. 2012-08-03 14:47:59,845 WARN org.apache.hadoop.conf.Configuration: /hadoop-default/mapred/taskTracker/hadoop/jobcache/job_201208031444_0002/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 2012-08-03 14:47:59,870 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201208031444_0002m-415719048 2012-08-03 14:47:59,871 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201208031444_0002m-415719048 spawned. 2012-08-03 14:47:59,874 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/attempt_201208031444_0002_m_000003_0/taskjvm.sh 2012-08-03 14:47:59,893 WARN org.apache.hadoop.mapred.DefaultTaskController: Exit code from task is : 1 2012-08-03 14:47:59,894 INFO org.apache.hadoop.mapred.JvmManager: JVM Not killed jvm_201208031444_0002m-415719048 but just removed 2012-08-03 14:47:59,895 WARN org.apache.hadoop.mapred.TaskRunner: attempt_201208031444_0002_m_000003_0 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) 2012-08-03 14:47:59,897 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201208031444_0002m-415719048 exited with exit code 1. Number of tasks it ran: 0 2012-08-03 14:48:02,928 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1 2012-08-03 14:48:03,172 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201208031444_0002_m_000003_1 task's state:UNASSIGNED 2012-08-03 14:48:03,173 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201208031444_0002_m_000003_1 which needs 1 slots 2012-08-03 14:48:03,173 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201208031444_0002_m_000003_1 which needs 1 slots 2012-08-03 14:48:03,205 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201208031444_0002m-507262889 2012-08-03 14:48:03,206 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201208031444_0002m-507262889 spawned. 2012-08-03 14:48:03,208 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/attempt_201208031444_0002_m_000003_1/taskjvm.sh 2012-08-03 14:48:03,227 WARN org.apache.hadoop.mapred.DefaultTaskController: Exit code from task is : 1 2012-08-03 14:48:03,227 INFO org.apache.hadoop.mapred.JvmManager: JVM Not killed jvm_201208031444_0002m-507262889 but just removed 2012-08-03 14:48:03,228 WARN org.apache.hadoop.mapred.TaskRunner: attempt_201208031444_0002_m_000003_1 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) 2012-08-03 14:48:03,228 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201208031444_0002m-507262889 exited with exit code 1. Number of tasks it ran: 0 2012-08-03 14:48:06,234 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1 2012-08-03 14:48:06,250 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201208031444_0002_m_000002_0 task's state:UNASSIGNED 2012-08-03 14:48:06,250 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201208031444_0002_m_000002_0 which needs 1 slots 2012-08-03 14:48:06,250 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201208031444_0002_m_000002_0 which needs 1 slots 2012-08-03 14:48:06,251 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201208031444_0002_m_000003_1 2012-08-03 14:48:06,271 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201208031444_0002m-1662756872 2012-08-03 14:48:06,271 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201208031444_0002m-1662756872 spawned. 2012-08-03 14:48:06,374 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/attempt_201208031444_0002_m_000002_0/taskjvm.sh 2012-08-03 14:48:06,397 WARN org.apache.hadoop.mapred.DefaultTaskController: Exit code from task is : 1 2012-08-03 14:48:06,398 INFO org.apache.hadoop.mapred.JvmManager: JVM Not killed jvm_201208031444_0002m-1662756872 but just removed 2012-08-03 14:48:06,398 WARN org.apache.hadoop.mapred.TaskRunner: attempt_201208031444_0002_m_000002_0 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) 2012-08-03 14:48:06,398 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201208031444_0002m-1662756872 exited with exit code 1. Number of tasks it ran: 0 2012-08-03 14:48:09,407 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1 2012-08-03 14:48:09,632 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201208031444_0002_m_000002_1 task's state:UNASSIGNED 2012-08-03 14:48:09,632 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201208031444_0002_m_000002_1 which needs 1 slots 2012-08-03 14:48:09,632 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 1 and trying to launch attempt_201208031444_0002_m_000002_1 which needs 1 slots 2012-08-03 14:48:09,658 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201208031444_0002_m_543396029 2012-08-03 14:48:09,658 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201208031444_0002_m_543396029 spawned. 2012-08-03 14:48:09,662 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /hadoop-default/mapred/ttprivate/taskTracker/hadoop/jobcache/job_201208031444_0002/attempt_201208031444_0002_m_000002_1/taskjvm.sh 2012-08-03 14:48:09,685 WARN org.apache.hadoop.mapred.DefaultTaskController: Exit code from task is : 1 2012-08-03 14:48:09,686 INFO org.apache.hadoop.mapred.JvmManager: JVM Not killed jvm_201208031444_0002_m_543396029 but just removed 2012-08-03 14:48:09,686 WARN org.apache.hadoop.mapred.TaskRunner: attempt_201208031444_0002_m_000002_1 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) 2012-08-03 14:48:09,687 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201208031444_0002_m_543396029 exited with exit code 1. Number of tasks it ran: 0 2012-08-03 14:48:12,693 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 1 2012-08-03 14:48:13,057 INFO org.apache.hadoop.mapred.TaskTracker: Received 'KillJobAction' for job: job_201208031444_0002 2012-08-03 14:48:13,057 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201208031444_0002 for user-log deletion with retainTimeStamp:1344116893057

Can you check the actual job's log. it should have the Query tree written

Hope this is what you asked for.

Hive History Job Log:

cat /var/log/hadoop/history/done/hive1_1344030289502_job_201208031444_0002_hadoop_Windowing+Query%3A+Query%3A%0A%09tableInput%3D%28hiveTable%3DWin Meta VERSION="1" . Job JOBID="job_201208031444_0002" JOBNAME="Windowing Query: Query: tableInput\=(hiveTable\=WindowingTempTable_1344030455741 partitionColumns\=uuid orderColumns\=uuid ASC) tableFuncSpec\=null funcSpecs\=[count(alias\=uuid_cnt, param\=[strVal\=uuid], type\=null, window\=null)] select\=uuid, uuid_cnt whereExpr\=null tableOutput\=(output(path\=/user/hadoop/wout, serde\=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, serDeProps\={field.delim\=,, columns\=uuid,uuid_cnt, columns.types\=string,int}, format\=org.apache.hadoop.mapred.TextOutputFormat) " USER="hadoop" SUBMIT_TIME="1344030477955" JOBCONF="hdfs://hive1:41210/tmp/hadoop-mapred/mapred/staging/hadoop/.staging/job_201208031444_0002/job.xml" VIEWJOB="" MODIFYJOB="" JOB_QUEUE="default" . Job JOBID="job_201208031444_0002" JOB_PRIORITY="NORMAL" . Job JOBID="job_201208031444_0002" LAUNCH_TIME="1344030478310" TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" . Task TASKID="task_201208031444_0002_m_000003" TASK_TYPE="SETUP" START_TIME="1344030478582" SPLITS="" . MapAttempt TASK_TYPE="SETUP" TASKID="task_201208031444_0002_m_000003" TASK_ATTEMPT_ID="attempt_201208031444_0002_m_000003_0" START_TIME="1344030479851" TRACKER_NAME="tracker_hive1:localhost.localdomain/127.0.0.1:37074" HTTP_PORT="50060" . MapAttempt TASK_TYPE="SETUP" TASKID="task_201208031444_0002_m_000003" TASK_ATTEMPT_ID="attempt_201208031444_0002_m_000003_0" TASK_STATUS="FAILED" FINISH_TIME="1344030482928" HOSTNAME="hive1" ERROR="java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) " . MapAttempt TASK_TYPE="SETUP" TASKID="task_201208031444_0002_m_000003" TASK_ATTEMPT_ID="attempt_201208031444_0002_m_000003_1" START_TIME="1344030483175" TRACKER_NAME="tracker_hive1:localhost.localdomain/127.0.0.1:37074" HTTP_PORT="50060" . MapAttempt TASK_TYPE="SETUP" TASKID="task_201208031444_0002_m_000003" TASK_ATTEMPT_ID="attempt_201208031444_0002_m_000003_1" TASK_STATUS="FAILED" FINISH_TIME="1344030486234" HOSTNAME="hive1" ERROR="java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) " . Task TASKID="task_201208031444_0002_m_000003" TASK_TYPE="SETUP" TASK_STATUS="FAILED" FINISH_TIME="1344030486234" ERROR="java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) " TASK_ATTEMPT_ID="" . Task TASKID="task_201208031444_0002_m_000002" TASK_TYPE="CLEANUP" START_TIME="1344030486247" SPLITS="" . MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201208031444_0002_m_000002" TASK_ATTEMPT_ID="attempt_201208031444_0002_m_000002_0" START_TIME="1344030486251" TRACKER_NAME="tracker_hive1:localhost.localdomain/127.0.0.1:37074" HTTP_PORT="50060" .MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201208031444_0002_m_000002" TASK_ATTEMPT_ID="attempt_201208031444_0002_m_000002_0" TASK_STATUS="FAILED" FINISH_TIME="1344030489407" HOSTNAME="hive1" ERROR="java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229)" . MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201208031444_0002_m_000002" TASK_ATTEMPT_ID="attempt_201208031444_0002_m_000002_1" START_TIME="1344030489634" TRACKER_NAME="tracker_hive1:localhost.localdomain/127.0.0.1:37074" HTTP_PORT="50060" . MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201208031444_0002_m_000002" TASK_ATTEMPT_ID="attempt_201208031444_0002_m_000002_1" TASK_STATUS="FAILED" FINISH_TIME="1344030492693" HOSTNAME="hive1" ERROR="java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229)" .Task TASKID="task_201208031444_0002_m_000002" TASK_TYPE="CLEANUP" TASK_STATUS="FAILED" FINISH_TIME="1344030492693" ERROR="java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242)Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229) " TASK_ATTEMPT_ID="" .Job JOBID="job_201208031444_0002" FINISH_TIME="1344030492995" JOB_STATUS="FAILED" FINISHED_MAPS="0" FINISHED_REDUCES="0" .

Hive Job Log (hive_job_log_hadoop_201208031447_1114519429.txt):

SessionStart SESSION_ID="hadoop_201208031447" TIME="1344030445166" QueryStart QUERY_STRING=" use analytics" QUERY_ID="hadoop_20120803144747_d7f9baf6-296a-431a-9e10-87a781714f0d" TIME="1344030446425" Counters plan="{"queryId":"hadoop_20120803144747_d7f9baf6-296a-431a-9e10-87a781714f0d","queryType":null,"queryAttributes":{"queryString":" use analytics"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":"]"},"stageList":[{"stageId":"Stage-0","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030446444" TaskStart TASK_NAME="org.apache.hadoop.hive.ql.exec.DDLTask" TASK_ID="Stage-0" QUERY_ID="hadoop_20120803144747_d7f9baf6-296a-431a-9e10-87a781714f0d" TIME="1344030446504" Counters plan="{"queryId":"hadoop_20120803144747_d7f9baf6-296a-431a-9e10-87a781714f0d","queryType":null,"queryAttributes":{"queryString":" use analytics"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":"]"},"stageList":[{"stageId":"Stage-0","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"true"}],"done":"false","started":"true"}],"done":"false","started":"true"}" TIME="1344030446506" Counters plan="{"queryId":"hadoop_20120803144747_d7f9baf6-296a-431a-9e10-87a781714f0d","queryType":null,"queryAttributes":{"queryString":" use analytics"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":"]"},"stageList":[{"stageId":"Stage-0","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"false","started":"true"}" TIME="1344030455025" TaskEnd TASK_RET_CODE="0" TASK_NAME="org.apache.hadoop.hive.ql.exec.DDLTask" TASK_ID="Stage-0" QUERY_ID="hadoop_20120803144747_d7f9baf6-296a-431a-9e10-87a781714f0d" TIME="1344030455025" QueryEnd QUERY_STRING=" use analytics" QUERY_ID="hadoop_20120803144747_d7f9baf6-296a-431a-9e10-87a781714f0d" QUERY_RET_CODE="0" QUERY_NUM_TASKS="0" TIME="1344030455025" Counters plan="{"queryId":"hadoop_20120803144747_d7f9baf6-296a-431a-9e10-87a781714f0d","queryType":null,"queryAttributes":{"queryString":" use analytics"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":"]"},"stageList":[{"stageId":"Stage-0","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"}" TIME="1344030455026" QueryStart QUERY_STRING="Create table WindowingTempTable_1344030455741 as select uuid from testtable" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030456924" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030456929" TaskStart TASK_NAME="org.apache.hadoop.hive.ql.exec.MapRedTask" TASK_ID="Stage-1" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030456932" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030457019" TaskProgress TASK_HADOOP_PROGRESS="2012-08-03 14:47:48,380 Stage-1 map = 0%, reduce = 0%" TASK_NAME="org.apache.hadoop.hive.ql.exec.MapRedTask" TASK_COUNTERS="org.apache.hadoop.hive.ql.exec.Operator$ProgressCounter.CREATED_FILES:0,Job Counters .SLOTS_MILLIS_MAPS:5692,Job Counters .Launched map tasks:1,Job Counters .Data-local map tasks:1" TASK_ID="Stage-1" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TASK_HADOOP_ID="job_201208031444_0001" TIME="1344030468381" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"0","CNTR_NAME_Stage-1_MAP_PROGRESS":"0"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"false","started":"false"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030468382" TaskProgress ROWS_INSERTED="hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_14-47-35_812_4894441392788894923/-ext-10000~8" TASK_HADOOP_PROGRESS="2012-08-03 14:47:51,570 Stage-1 map = 100%, reduce = 100%" TASK_NAME="org.apache.hadoop.hive.ql.exec.MapRedTask" TASK_COUNTERS="org.apache.hadoop.hive.ql.exec.Operator$ProgressCounter.CREATED_FILES:1,Job Counters .SLOTS_MILLIS_MAPS:7728,Job Counters .Total time spent by all reduces waiting after reserving slots (ms):0,Job Counters .Total time spent by all maps waiting after reserving slots (ms):0,Job Counters .Launched map tasks:1,Job Counters .Data-local map tasks:1,Job Counters .SLOTS_MILLIS_REDUCES:0,FileSystemCounters.HDFS_BYTES_READ:541,FileSystemCounters.FILE_BYTES_WRITTEN:77719,FileSystemCounters.HDFS_BYTES_WRITTEN:328,org.apache.hadoop.hive.ql.exec.FileSinkOperator$TableIdEnum.TABLE_ID_1_ROWCOUNT:8,org.apache.hadoop.hive.ql.exec.MapOperator$Counter.DESERIALIZE_ERRORS:0,Map-Reduce Framework.Map input records:8,Map-Reduce Framework.Physical memory (bytes) snapshot:73170944,Map-Reduce Framework.Spilled Records:0,Map-Reduce Framework.CPU time spent (ms):670,Map-Reduce Framework.Total committed heap usage (bytes):31916032,Map-Reduce Framework.Virtual memory (bytes) snapshot:577486848,Map-Reduce Framework.Map input bytes:0,Map-Reduce Framework.Map output records:0,Map-Reduce Framework.SPLIT_RAW_BYTES:205" TASK_ID="Stage-1" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TASK_HADOOP_ID="job_201208031444_0001" TIME="1344030471573" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"false","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471573" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471592" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471715" TaskEnd ROWS_INSERTED="hdfs://hive1:41210/tmp/hive-hadoop/hive_2012-08-03_14-47-35_812_4894441392788894923/-ext-10000~8" TASK_RET_CODE="0" TASK_HADOOP_PROGRESS="2012-08-03 14:47:51,570 Stage-1 map = 100%, reduce = 100%" TASK_NAME="org.apache.hadoop.hive.ql.exec.MapRedTask" TASK_COUNTERS="org.apache.hadoop.hive.ql.exec.Operator$ProgressCounter.CREATED_FILES:1,Job Counters .SLOTS_MILLIS_MAPS:7728,Job Counters .Total time spent by all reduces waiting after reserving slots (ms):0,Job Counters .Total time spent by all maps waiting after reserving slots (ms):0,Job Counters .Launched map tasks:1,Job Counters .Data-local map tasks:1,Job Counters .SLOTS_MILLIS_REDUCES:0,FileSystemCounters.HDFS_BYTES_READ:541,FileSystemCounters.FILE_BYTES_WRITTEN:77719,FileSystemCounters.HDFS_BYTES_WRITTEN:328,org.apache.hadoop.hive.ql.exec.FileSinkOperator$TableIdEnum.TABLE_ID_1_ROWCOUNT:8,org.apache.hadoop.hive.ql.exec.MapOperator$Counter.DESERIALIZE_ERRORS:0,Map-Reduce Framework.Map input records:8,Map-Reduce Framework.Physical memory (bytes) snapshot:73170944,Map-Reduce Framework.Spilled Records:0,Map-Reduce Framework.CPU time spent (ms):670,Map-Reduce Framework.Total committed heap usage (bytes):31916032,Map-Reduce Framework.Virtual memory (bytes) snapshot:577486848,Map-Reduce Framework.Map input bytes:0,Map-Reduce Framework.Map output records:0,Map-Reduce Framework.SPLIT_RAW_BYTES:205" TASK_ID="Stage-1" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TASK_HADOOP_ID="job_201208031444_0001" TIME="1344030471715" TaskStart TASK_NAME="org.apache.hadoop.hive.ql.exec.ConditionalTask" TASK_ID="Stage-4" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030471715" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"true"}],"done":"false","started":"true"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471717" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"true"}],"done":"false","started":"true"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471723" TaskStart TASK_NAME="org.apache.hadoop.hive.ql.exec.MoveTask" TASK_ID="Stage-3" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030471724" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"true"}],"done":"false","started":"true"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"true"}],"done":"false","started":"true"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471733" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471743" TaskEnd TASK_RET_CODE="0" TASK_NAME="org.apache.hadoop.hive.ql.exec.ConditionalTask" TASK_ID="Stage-4" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030471743" TaskEnd TASK_RET_CODE="0" TASK_NAME="org.apache.hadoop.hive.ql.exec.MoveTask" TASK_ID="Stage-3" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030471743" TaskStart TASK_NAME="org.apache.hadoop.hive.ql.exec.MoveTask" TASK_ID="Stage-0" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030471743" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471745" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"null","stageCounters":{"CNTR_NAME_Stage-1_REDUCE_PROGRESS":"100","CNTR_NAME_Stage-1_MAP_PROGRESS":"100"},"taskList":[{"taskId":"Stage-1_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_0","children":["SEL_1"],"adjacencyType":"CONJUNCTIVE"},{"node":"SEL_1","children":["FS_2"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_0","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"}","done":"true","started":"true"},{"operatorId":"SEL_1","operatorType":"SELECT","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"},{"operatorId":"FS_2","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"true","started":"true"}],"done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-4","stageType":"CONDITIONAL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-4_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-3","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-3_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"true","started":"true"}],"done":"true","started":"true"},{"stageId":"Stage-2","stageType":"MAPRED","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-2_MAP","taskType":"MAP","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"OPERATOR","roots":"null","adjacencyList":[{"node":"TS_3","children":["FS_4"],"adjacencyType":"CONJUNCTIVE"}]},"operatorList":[{"operatorId":"TS_3","operatorType":"TABLESCAN","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"},{"operatorId":"FS_4","operatorType":"FILESINK","operatorAttributes":"null","operatorCounters":"null","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-0","stageType":"MOVE","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-0_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"},{"stageId":"Stage-5","stageType":"DDL","stageAttributes":"null","stageCounters":"}","taskList":[{"taskId":"Stage-5_OTHER","taskType":"OTHER","taskAttributes":"null","taskCounters":"null","operatorGraph":"null","operatorList":"]","done":"false","started":"false"}],"done":"false","started":"false"}],"done":"false","started":"true"}" TIME="1344030471756" TaskEnd TASK_RET_CODE="0" TASK_NAME="org.apache.hadoop.hive.ql.exec.MoveTask" TASK_ID="Stage-0" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030471757" TaskStart TASK_NAME="org.apache.hadoop.hive.ql.exec.DDLTask" TASK_ID="Stage-5" QUERY_ID="hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf" TIME="1344030471757" Counters plan="{"queryId":"hadoop_20120803144747_86297034-8121-4bc4-a814-ed5d2e1323cf","queryType":null,"queryAttributes":{"queryString":"Create table WindowingTempTable_1344030455741 as select uuid from testtable"},"queryCounters":"null","stageGraph":{"nodeType":"STAGE","roots":"null","adjacencyList":[{"node":"Stage-1","children":["Stage-4"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-4","children":["Stage-3","Stage-2"],"adjacencyType":"DISJUNCTIVE"},{"node":"Stage-3","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-2","children":["Stage-0"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"},{"node":"Stage-0","children":["Stage-5"],"adjacencyType":"CONJUNCTIVE"}]},"stageList":[{"stageId":"Stage-1","stageType":"MAPRED","stageAttributes":"nul

Not much here to tell what happened. Can you see if there is anything in the Map Task log; can you also see the .out file. Maybe some clue there.

Also is there a way I can try to reproduce this locally? Could you send me your table's information: schema, sample data, what Format/SerDes you are using

Let me try getting you what I can. Again thanks,

I was trying this on a very simple table first:

"testtable": uuid string c_51 string

The content: B73JKFOE83JSLDFU38FFDFE833JKFI9SO99FESUF B73JKFOE83JSLDFU38FFDFE833JKFI9SO99FESUF DE23834KEIEFJEAIF3AO83AOFJ3FAJEDFJAOEFA3 4DKFEIA83KFIAEF83JKFA83JKFA38ARFJKFA38FA 4DKFEIA83KFIAEF83JKFA83JKFA38ARFJKFA38FA DE23834KEIEFJEAIF3AO83AOFJ3FAJEDFJAOEFA3 4DKFEIA83KFIAEF83JKFA83JKFA38ARFJKFA38FA 4DKFEIA83KFIAEF83JKFA83JKFA38ARFJKFA38FA

uuid had those values while c_51 is just an empty string.

I'm running an instance of CDH3u3 locally on my laptop on a VM - 1 Node. It has 2gb Ram allocated. About 15GB free of storage.

Hive is configured to use MySQL.

No Format/SerDes for this example. Trying to get something simple working.

My HQL i put in a file: wmode hive; use analytics; wmode windowing; from

hbutani / SQLWindowing