Closed splikhita closed 7 years ago
@splikhita I'll need TRACE
level logs here to diagnose the exact problem, but it's possible that your data is simply malformed in some spots and Elasticsearch cannot parse it successfully.
This is the latest Pig Stack Trace I could find sir:
Pig Stack Trace
---------------
ERROR 1003: Unable to find an operator for alias ES
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1003: Unable to find an operator for alias ES
at org.apache.pig.PigServer$Graph.buildPlan(PigServer.java:1544)
at org.apache.pig.PigServer.storeEx(PigServer.java:1029)
at org.apache.pig.PigServer.store(PigServer.java:997)
at org.apache.pig.PigServer.openIterator(PigServer.java:910)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:754)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:376)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
at org.apache.pig.Main.run(Main.java:565)
at org.apache.pig.Main.main(Main.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
@splikhita This seems to be a completely different problem than the one you posted above. I took a look around and this error seems to be tied to problems with the Pig Script syntax. Are you still seeing the previous stack trace in this case? Have you modified your script in any way?
Right now I'm unable to load a json file to elasticsearch using pig. Rest works fine sir.
I couldn't find any other logs except these on my Home directory. While uploading json it gives me this:
2017-07-25 12:21:17,674 [Thread-301] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local1500679296_0008
java.lang.Exception: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found unrecoverable error [Bad Request(400) - [MapperParsingException[failed to parse]; nested: ElasticsearchParseException[Failed to derive xcontent]; ]]; Bailing out..
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found unrecoverable error [Bad Request(400) - [MapperParsingException[failed to parse]; nested: ElasticsearchParseException[Failed to derive xcontent]; ]]; Bailing out..
at org.elasticsearch.hadoop.rest.RestClient.retryFailedEntries(RestClient.java:203)
at org.elasticsearch.hadoop.rest.RestClient.bulk(RestClient.java:167)
at org.elasticsearch.hadoop.rest.RestRepository.tryFlush(RestRepository.java:209)
at org.elasticsearch.hadoop.rest.RestRepository.flush(RestRepository.java:232)
at org.elasticsearch.hadoop.rest.RestRepository.close(RestRepository.java:250)
at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.doClose(EsOutputFormat.java:214)
at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.close(EsOutputFormat.java:196)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.close(PigOutputFormat.java:146)
at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:670)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2017-07-25 12:21:22,664 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
Right now I'm unable to load a json file to elasticsearch using pig. Rest works fine sir.
Loading JSON to Elasticsearch through ES-Hadoop uses the same Rest Client under the hood. The only thing that is different is how it parses the data (in json mode it just uses the json string as the document).
I couldn't find any other logs except these on my Home directory.
When you launch the Pig script, is it spinning up a job on your Hadoop cluster? Can you pull the logs from the worker nodes? You should be able to configure your Hadoop cluster to increase the logging level of org.elasticsearch.hadoop.rest.commonshttp
to TRACE
, which means that when the job runs the worker logs will display the Request and Responses from Elasticsearch. This will allow you to see exactly which piece of data was unable to be processed.
grunt> REGISTER hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar;
Have you tried using a newer ES-Hadoop version? The latest release (5.5.1) should be backwards compatible with Elasticsearch 1.7.x.
I'm not using a cluster, I'm running it on a single node.
@splikhita In your pig installation location, there should be a conf
directory. Copy the log4j.properties.template
file to a new file name and add this line to it:
log4j.logger.org.elasticsearch.hadoop=trace, A
When you start up pig in local mode, run the command like so:
pig -v -x local -4 </path/to/that/copied/log4j.properties>
At this point, the shell should be logging the hadoop package at TRACE
level into the console that you are running. Once you are in the console, run your job and link the entire contents of the console here.
I've done what you have said. When the job is run on the console, here is what it gives:
[eshadoop@localhost ~]$ pig -v -x local -4 /usr/local/pig/conf/samplelog4j.properties
17/07/26 16:14:02 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
17/07/26 16:14:02 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
17/07/26 16:14:02 INFO pig.Main: Loaded log4j properties from file: /usr/local/pig/conf/samplelog4j.properties
23 [main] INFO org.apache.pig.Main - Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35
17/07/26 16:14:02 INFO pig.Main: Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35
24 [main] INFO org.apache.pig.Main - Logging error messages to: /home/eshadoop/pig_1501100042386.log
17/07/26 16:14:02 INFO pig.Main: Logging error messages to: /home/eshadoop/pig_1501100042386.log
41 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /home/eshadoop/.pigbootup not found
17/07/26 16:14:02 INFO util.Utils: Default bootup file /home/eshadoop/.pigbootup not found
17/07/26 16:14:02 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/26 16:14:02 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
173 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
17/07/26 16:14:02 INFO executionengine.HExecutionEngine: Connecting to hadoop file system at: file:///
17/07/26 16:14:02 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
301 [main] DEBUG org.apache.pig.tools.grunt.PigCompletor - Can not find autocomplete file in current directory, skipped
17/07/26 16:14:02 DEBUG grunt.PigCompletor: Can not find autocomplete file in current directory, skipped
grunt>
And when I run it after starting pig i.e., in the grunt mode:
Pig Stack Trace
---------------
ERROR 1000: Error during parsing. Encountered " <IDENTIFIER> "pig "" at line 1, column 1.
Was expecting one of:
<EOF>
"cat" ...
"clear" ...
"fs" ...
"sh" ...
"cd" ...
"cp" ...
"copyFromLocal" ...
"copyToLocal" ...
"dump" ...
"\\d" ...
"describe" ...
"\\de" ...
"aliases" ...
"explain" ...
"\\e" ...
"help" ...
"history" ...
"kill" ...
"ls" ...
"mv" ...
"mkdir" ...
"pwd" ...
"quit" ...
"\\q" ...
"register" ...
"rm" ...
"rmf" ...
"set" ...
"illustrate" ...
"\\i" ...
"run" ...
"exec" ...
"%default" ...
"%declare" ...
"scriptDone" ...
"" ...
"" ...
<EOL> ...
";" ...
org.apache.pig.tools.pigscript.parser.ParseException: Encountered " <IDENTIFIER> "pig "" at line 1, column 1.
Was expecting one of:
<EOF>
"cat" ...
"clear" ...
"fs" ...
"sh" ...
"cd" ...
"cp" ...
"copyFromLocal" ...
"copyToLocal" ...
"dump" ...
"\\d" ...
"describe" ...
"\\de" ...
"aliases" ...
"explain" ...
"\\e" ...
"help" ...
"history" ...
"kill" ...
"ls" ...
"mv" ...
"mkdir" ...
"pwd" ...
"quit" ...
"\\q" ...
"register" ...
"rm" ...
"rmf" ...
"set" ...
"illustrate" ...
"\\i" ...
"run" ...
"exec" ...
"%default" ...
"%declare" ...
"scriptDone" ...
"" ...
"" ...
<EOL> ...
";" ...
at org.apache.pig.tools.pigscript.parser.PigScriptParser.generateParseException(PigScriptParser.java:1498)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.handle_invalid_command(PigScriptParser.java:1306)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:726)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
at org.apache.pig.Main.run(Main.java:565)
at org.apache.pig.Main.main(Main.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
@splikhita It looks like you're running the Pig command to open the terminal then running the pig command again. What are your commands you're trying to run here?
Okay I've run the pig command that you asked me to:
pig -v -x local -4 </path/to/that/copied/log4j.properties>
The result for it is as follows:
[eshadoop@localhost ~]$ pig -v -x local -4 /usr/local/pig/conf/samplelog4j.properties
17/07/26 16:14:02 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
17/07/26 16:14:02 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
17/07/26 16:14:02 INFO pig.Main: Loaded log4j properties from file: /usr/local/pig/conf/samplelog4j.properties
23 [main] INFO org.apache.pig.Main - Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35
17/07/26 16:14:02 INFO pig.Main: Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35
24 [main] INFO org.apache.pig.Main - Logging error messages to: /home/eshadoop/pig_1501100042386.log
17/07/26 16:14:02 INFO pig.Main: Logging error messages to: /home/eshadoop/pig_1501100042386.log
41 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /home/eshadoop/.pigbootup not found
17/07/26 16:14:02 INFO util.Utils: Default bootup file /home/eshadoop/.pigbootup not found
17/07/26 16:14:02 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/26 16:14:02 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
173 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
17/07/26 16:14:02 INFO executionengine.HExecutionEngine: Connecting to hadoop file system at: file:///
17/07/26 16:14:02 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
301 [main] DEBUG org.apache.pig.tools.grunt.PigCompletor - Can not find autocomplete file in current directory, skipped
17/07/26 16:14:02 DEBUG grunt.PigCompletor: Can not find autocomplete file in current directory, skipped
grunt>
@splikhita Now that the grunt shell is started, can you run your regular Pig commands and post the full console log here?
This used to run successfully before but now I get some errors and the job failed.
grunt> REGISTER hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar;
2395066 [main] DEBUG org.apache.pig.PigServer - Ignoring duplicate registration for jar hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar
17/07/26 16:53:57 DEBUG pig.PigServer: Ignoring duplicate registration for jar hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar
grunt> SET default_parallel 5;
grunt> SET pig.splitCombination FALSE;
grunt> SOURCE = load '/ch07/crimes_dataset.csv' using PigStorage(',') as (id:chararray, caseNumber:chararray, date:datetime, block:chararray, iucr:chararray, primaryType:chararray, description:chararray, location:chararray, arrest:boolean, domestic:boolean, lat:double,lon:double);
2420106 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
17/07/26 16:54:22 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
2420107 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
17/07/26 16:54:22 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
2420107 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
17/07/26 16:54:22 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420115 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420118 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420118 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420122 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/26 16:54:22 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/26 16:54:22 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420161 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420167 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
17/07/26 16:54:22 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
2420167 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
17/07/26 16:54:22 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
2420168 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
17/07/26 16:54:22 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420174 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420177 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420183 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420190 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420191 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420204 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420205 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
grunt> TARGET = foreach SOURCE generate id, caseNumber, date, block, iucr, primaryType, description, location, arrest, domestic, TOTUPLE(lon, lat) AS geoLocation;
2517599 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
17/07/26 16:55:59 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
2517599 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
17/07/26 16:55:59 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
2517600 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
17/07/26 16:55:59 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
2517602 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517605 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:55:59 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517606 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517606 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517612 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:55:59 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517618 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:55:59 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517624 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517624 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517624 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517624 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517637 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
17/07/26 16:56:00 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
2517637 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
17/07/26 16:56:00 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
2517637 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
17/07/26 16:56:00 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517641 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:56:00 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517646 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:56:00 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517650 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:56:00 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
grunt> STORE TARGET INTO 'esh_pig/crimes' USING org.elasticsearch.hadoop.pig.EsStorage('es.http.timeout = 5m', 'es.index.auto.create = true', 'es.mapping.names=arrest:isArrest, domestic:isDomestic', 'es.mapping.id=id', 'es.mapping.pig.tuple.use.field.names=true');
2712421 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
17/07/26 16:59:14 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
2712421 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
17/07/26 16:59:14 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
2712422 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
17/07/26 16:59:14 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712428 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712433 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712436 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712436 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712436 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712438 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712438 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712438 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/26 16:59:14 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/26 16:59:14 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
2712463 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712471 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
17/07/26 16:59:14 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
2712471 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
17/07/26 16:59:14 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
2712471 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
17/07/26 16:59:14 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712475 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712479 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712479 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712479 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712486 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage - Using pre-defined writer serializer [org.elasticsearch.hadoop.pig.PigValueWriter] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined writer serializer [org.elasticsearch.hadoop.pig.PigValueWriter] as default
2712486 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage - Using pre-defined reader serializer [org.elasticsearch.hadoop.pig.PigValueReader] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined reader serializer [org.elasticsearch.hadoop.pig.PigValueReader] as default
2712486 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage - Using pre-defined field extractor [org.elasticsearch.hadoop.pig.PigFieldExtractor] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined field extractor [org.elasticsearch.hadoop.pig.PigFieldExtractor] as default
2712486 [main] WARN org.elasticsearch.hadoop.mr.EsOutputFormat - Speculative execution enabled for reducer - consider disabling it to prevent data corruption
17/07/26 16:59:14 WARN mr.EsOutputFormat: Speculative execution enabled for reducer - consider disabling it to prevent data corruption
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712489 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: UNKNOWN
17/07/26 16:59:14 INFO pigstats.ScriptState: Pig features used in the script: UNKNOWN
17/07/26 16:59:14 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/26 16:59:14 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/26 16:59:14 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2712523 [main] INFO org.apache.pig.data.SchemaTupleBackend - Key [pig.schematuple] was not set... will not generate code.
17/07/26 16:59:14 INFO data.SchemaTupleBackend: Key [pig.schematuple] was not set... will not generate code.
2712523 [main] INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, ConstantCalculator, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, PartitionFilterOptimizer, PredicatePushdownOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter]}
17/07/26 16:59:14 INFO optimizer.LogicalPlanOptimizer: {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, ConstantCalculator, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, PartitionFilterOptimizer, PredicatePushdownOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter]}
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.data.SchemaTupleFrontend - Registering Schema for generation [{double,double}] with id [0] and context: UDF
17/07/26 16:59:14 DEBUG data.SchemaTupleFrontend: Registering Schema for generation [{double,double}] with id [0] and context: UDF
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.data.SchemaTupleFrontend - Registering Schema for generation [{(double,double)}] with id [1] and context: UDF
17/07/26 16:59:14 DEBUG data.SchemaTupleFrontend: Registering Schema for generation [{(double,double)}] with id [1] and context: UDF
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712527 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712527 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712527 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712527 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.data.SchemaTupleFrontend - Registering Schema for generation [{chararray,chararray,datetime,chararray,chararray,chararray,chararray,chararray,boolean,boolean,(double,double)}] with id [2] and context: FOREACH
17/07/26 16:59:14 DEBUG data.SchemaTupleFrontend: Registering Schema for generation [{chararray,chararray,datetime,chararray,chararray,chararray,chararray,chararray,boolean,boolean,(double,double)}] with id [2] and context: FOREACH
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712529 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false
17/07/26 16:59:14 INFO mapReduceLayer.MRCompiler: File concatenation threshold: 100 optimistic? false
2712529 [main] DEBUG org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.SampleOptimizer - Not a sampling job.
17/07/26 16:59:14 DEBUG mapReduceLayer.SampleOptimizer: Not a sampling job.
2712529 [main] TRACE org.apache.pig.backend.hadoop.executionengine.util.SecondaryKeyOptimizerUtil - Entering SecondaryKeyOptimizerUtil.addSecondaryKeySort
17/07/26 16:59:14 TRACE util.SecondaryKeyOptimizerUtil: Entering SecondaryKeyOptimizerUtil.addSecondaryKeySort
2712530 [main] DEBUG org.apache.pig.backend.hadoop.executionengine.util.SecondaryKeyOptimizerUtil - Cannot find POLocalRearrange or POUnion in map leaf, skip secondary key optimizing
17/07/26 16:59:14 DEBUG util.SecondaryKeyOptimizerUtil: Cannot find POLocalRearrange or POUnion in map leaf, skip secondary key optimizing
2712530 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 1
17/07/26 16:59:14 INFO mapReduceLayer.MultiQueryOptimizer: MR plan size before optimization: 1
2712530 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 1
17/07/26 16:59:14 INFO mapReduceLayer.MultiQueryOptimizer: MR plan size after optimization: 1
17/07/26 16:59:14 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/26 16:59:14 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/26 16:59:14 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2712541 [main] INFO org.apache.pig.tools.pigstats.mapreduce.MRScriptState - Pig script settings are added to the job
17/07/26 16:59:14 INFO mapreduce.MRScriptState: Pig script settings are added to the job
2712541 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
17/07/26 16:59:14 INFO mapReduceLayer.JobControlCompiler: mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2712553 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage - Using pre-defined writer serializer [org.elasticsearch.hadoop.pig.PigValueWriter] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined writer serializer [org.elasticsearch.hadoop.pig.PigValueWriter] as default
2712553 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage - Using pre-defined reader serializer [org.elasticsearch.hadoop.pig.PigValueReader] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined reader serializer [org.elasticsearch.hadoop.pig.PigValueReader] as default
2712553 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage - Using pre-defined field extractor [org.elasticsearch.hadoop.pig.PigFieldExtractor] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined field extractor [org.elasticsearch.hadoop.pig.PigFieldExtractor] as default
2712553 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
17/07/26 16:59:14 INFO mapReduceLayer.JobControlCompiler: Setting up single store job
2712554 [main] DEBUG org.apache.pig.data.SchemaTupleFrontend - Temporary directory for generated code created: /tmp/1501102754918-0
17/07/26 16:59:14 DEBUG data.SchemaTupleFrontend: Temporary directory for generated code created: /tmp/1501102754918-0
2712554 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Key [pig.schematuple] is false, will not generate code.
17/07/26 16:59:14 INFO data.SchemaTupleFrontend: Key [pig.schematuple] is false, will not generate code.
2712554 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Starting process to move generated code to distributed cacche
17/07/26 16:59:14 INFO data.SchemaTupleFrontend: Starting process to move generated code to distributed cacche
2712554 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /tmp/1501102754918-0
17/07/26 16:59:14 INFO data.SchemaTupleFrontend: Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /tmp/1501102754918-0
2712562 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map-reduce job(s) waiting for submission.
17/07/26 16:59:14 INFO mapReduceLayer.MapReduceLauncher: 1 map-reduce job(s) waiting for submission.
2712562 [main] DEBUG org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed to get job tracker location.
17/07/26 16:59:14 DEBUG mapReduceLayer.MapReduceLauncher: Failed to get job tracker location.
2712563 [JobControl] DEBUG org.apache.pig.backend.hadoop23.PigJobControl - Checking state of job job name: PigLatin:DefaultJobName
job id: job_pigexec_0
job state: WAITING
job mapred id: null
job message: just initialized
job has no depending job:
17/07/26 16:59:14 DEBUG hadoop23.PigJobControl: Checking state of job job name: PigLatin:DefaultJobName
job id: job_pigexec_0
job state: WAITING
job mapred id: null
job message: just initialized
job has no depending job:
17/07/26 16:59:14 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2712568 [JobControl] WARN org.elasticsearch.hadoop.mr.EsOutputFormat - Speculative execution enabled for reducer - consider disabling it to prevent data corruption
17/07/26 16:59:14 WARN mr.EsOutputFormat: Speculative execution enabled for reducer - consider disabling it to prevent data corruption
17/07/26 16:59:14 WARN mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
17/07/26 16:59:14 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-eshadoop/mapred/staging/eshadoop427912082/.staging/job_local427912082_0005
17/07/26 16:59:14 INFO jobcontrol.ControlledJob: PigLatin:DefaultJobName got an error while submitting
org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
at java.lang.Thread.run(Thread.java:748)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
... 18 more
2712680 [JobControl] DEBUG org.apache.pig.backend.hadoop23.PigJobControl - Checking state of job job name: PigLatin:DefaultJobName
job id: job_pigexec_0
job state: FAILED
job mapred id: job_local427912082_0005
job message: org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
at java.lang.Thread.run(Thread.java:748)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
... 18 more
job has no depending job:
17/07/26 16:59:15 DEBUG hadoop23.PigJobControl: Checking state of job job name: PigLatin:DefaultJobName
job id: job_pigexec_0
job state: FAILED
job mapred id: job_local427912082_0005
job message: org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
at java.lang.Thread.run(Thread.java:748)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
... 18 more
job has no depending job:
2712781 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_local427912082_0005
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: HadoopJobId: job_local427912082_0005
2712781 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases SOURCE,TARGET
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: Processing aliases SOURCE,TARGET
2712781 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: SOURCE[9,9],TARGET[-1,-1] C: R:
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: detailed locations: M: SOURCE[9,9],TARGET[-1,-1] C: R:
2712783 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: 0% complete
2712785 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
17/07/26 16:59:15 WARN mapReduceLayer.MapReduceLauncher: Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
2712785 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - job job_local427912082_0005 has failed! Stop running all dependent jobs
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: job job_local427912082_0005 has failed! Stop running all dependent jobs
2712785 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: 100% complete
17/07/26 16:59:15 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2712786 [main] ERROR org.apache.pig.tools.pigstats.PigStats - ERROR 0: java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING
17/07/26 16:59:15 ERROR pigstats.PigStats: ERROR 0: java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING
2712786 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 map reduce job(s) failed!
17/07/26 16:59:15 ERROR mapreduce.MRPigStatsUtil: 1 map reduce job(s) failed!
2712787 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics:
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
2.7.3 0.15.0 eshadoop 2017-07-26 16:59:14 2017-07-26 16:59:15 UNKNOWN
Failed!
Failed Jobs:
JobId Alias Feature Message Outputs
job_local427912082_0005 SOURCE,TARGET MAP_ONLY Message: org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
at java.lang.Thread.run(Thread.java:748)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
... 18 more
esh_pig/crimes,
Input(s):
Failed to read data from "/ch07/crimes_dataset.csv"
Output(s):
Failed to produce result in "esh_pig/crimes"
Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_local427912082_0005
17/07/26 16:59:15 INFO mapreduce.SimplePigStats: Script Statistics:
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
2.7.3 0.15.0 eshadoop 2017-07-26 16:59:14 2017-07-26 16:59:15 UNKNOWN
Failed!
Failed Jobs:
JobId Alias Feature Message Outputs
job_local427912082_0005 SOURCE,TARGET MAP_ONLY Message: org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
at java.lang.Thread.run(Thread.java:748)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
... 18 more
esh_pig/crimes,
Input(s):
Failed to read data from "/ch07/crimes_dataset.csv"
Output(s):
Failed to produce result in "esh_pig/crimes"
Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_local427912082_0005
2712788 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed!
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: Failed!
grunt>
There is a lot of data in the dataset. So there are more logs. Apologies!!
@splikhita Log volume is not a big deal. If you want you can always post the logs to a gist or a pastebin.
The error you're running into seems to be this:
Failed to read data from "/ch07/crimes_dataset.csv"
I'm assuming this data is normally stored on HDFS? You'll have to specify an absolute path for the file, and to make sure that the file exists before running the job.
The file exists in HDFS:
[eshadoop@localhost ~]$ hadoop fs -ls /ch07
Found 2 items
-rw-r--r-- 1 eshadoop supergroup 6321 2017-07-26 11:49 /ch07/crimes.json
-rw-r--r-- 1 eshadoop supergroup 131157 2017-07-26 16:48 /ch07/crimes_dataset.csv
@splikhita You might have to specify the file with the full HDFS path: hdfs://<hdfsNameNodeAddress>:<hdfsNameNodePort>/ch07/crimes.json
Tried it @jbaiera, it's the same:
grunt> JSON_DATA = LOAD 'hdfs://localhost:9000/ch07/crimes.json' USING PigStorage() AS (json:chararray);
76190 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/26 17:35:36 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
76191 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/26 17:35:36 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
76191 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/26 17:35:36 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
76194 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 17:35:36 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
76198 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes.json
17/07/26 17:35:36 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes.json
17/07/26 17:35:36 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/26 17:35:36 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/26 17:35:36 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
76230 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 17:35:36 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
76246 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for hdfs://localhost:9000/ch07/crimes.json
17/07/26 17:35:36 DEBUG builtin.JsonMetadata: Could not find schema file for hdfs://localhost:9000/ch07/crimes.json
76248 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/26 17:35:36 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
76248 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/26 17:35:36 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
76248 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/26 17:35:36 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
76250 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 17:35:36 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
76253 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for /ch07/crimes.json
17/07/26 17:35:36 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes.json
76254 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/26 17:35:36 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
76282 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for hdfs://localhost:9000/ch07/crimes.json
17/07/26 17:35:36 DEBUG builtin.JsonMetadata: Could not find schema file for hdfs://localhost:9000/ch07/crimes.json
@splikhita Can you try it with the file copied to your local machine instead of HDFS?
No luck sir.
17/07/26 17:42:18 DEBUG builtin.JsonMetadata: Could not find schema file for /home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json
I used this command for the above result:
JSON_DATA = LOAD '/home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' USING PigStorage() AS (json:chararray);
@splikhita This works for me if I preface the path with file://
, try with file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json
to see if that helps. If not, either the file is simply missing or you should open an issue with Pig as that does not seem to be related to the connector.
Gives me this error:
grunt> JSON_DATA = LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' USING PigStorage() AS (json:chararray);
152475 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/27 12:57:07 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
152475 [main] DEBUG org.apache.pig.parser.QueryParserDriver - macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/27 12:57:07 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
152475 [main] DEBUG org.apache.pig.parser.QueryParserDriver - Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/27 12:57:07 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))
17/07/27 12:57:07 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/27 12:57:07 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/27 12:57:07 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
152479 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/27 12:57:07 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
152486 [main] DEBUG org.apache.pig.builtin.JsonMetadata - Could not find schema file for file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json
17/07/27 12:57:07 DEBUG builtin.JsonMetadata: Could not find schema file for file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json
17/07/27 12:57:07 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/27 12:57:07 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/27 12:57:07 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
152516 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema - t: 55 Bag: 120 tuple: 110
17/07/27 12:57:07 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
152520 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1200: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
17/07/27 12:57:07 ERROR grunt.Grunt: ERROR 1200: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
152520 [main] ERROR org.apache.pig.tools.grunt.Grunt - Failed to parse: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:201)
at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680)
at org.apache.pig.PigServer.registerQuery(PigServer.java:623)
at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1082)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:505)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
at org.apache.pig.Main.run(Main.java:565)
at org.apache.pig.Main.main(Main.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.IllegalArgumentException: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:648)
at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:82)
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:606)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1426)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.isContainer(HDataStorage.java:200)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:128)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:144)
at org.apache.pig.impl.io.FileLocalizer.fullPath(FileLocalizer.java:327)
at org.apache.pig.builtin.JsonMetadata.findMetaFile(JsonMetadata.java:111)
at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:189)
at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:538)
at org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:175)
at org.apache.pig.newplan.logical.relational.LOLoad.<init>(LOLoad.java:89)
at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:901)
at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3568)
at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1625)
at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
... 16 more
17/07/27 12:57:07 ERROR grunt.Grunt: Failed to parse: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:201)
at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680)
at org.apache.pig.PigServer.registerQuery(PigServer.java:623)
at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1082)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:505)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
at org.apache.pig.Main.run(Main.java:565)
at org.apache.pig.Main.main(Main.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.IllegalArgumentException: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:648)
at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:82)
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:606)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1426)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.isContainer(HDataStorage.java:200)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:128)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:144)
at org.apache.pig.impl.io.FileLocalizer.fullPath(FileLocalizer.java:327)
at org.apache.pig.builtin.JsonMetadata.findMetaFile(JsonMetadata.java:111)
at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:189)
at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:538)
at org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:175)
at org.apache.pig.newplan.logical.relational.LOLoad.<init>(LOLoad.java:89)
at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:901)
at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3568)
at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1625)
at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
... 16 more
Details also at logfile: /home/eshadoop/pig_1501174475369.log
@splikhita Unfortunately it looks like this a problem with your version of Pig. I would move this discussion to the Pig Mailing list to see if they have any input. I'm going to close this out for now.
The easier it is to track down the bug, the faster it is solved.
Issue description
I'm trying to load a json document to elasticsearch and run but it pops out an error
Description
Used the below command to load data:
Steps to reproduce
Below is the error:
Version Info
OS: : CentOS 7 JVM : 1.8.0_131 Hadoop: Hadoop 2.7.3 ES : 1.7.1