search

elastic / elasticsearch-hadoop

:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
https://www.elastic.co/products/hadoop
Apache License 2.0
1.93k stars 990 forks source link

ES-Hadoop Pig #1026

Closed splikhita closed 7 years ago

splikhita commented 7 years ago

I'm trying to load a json document to elasticsearch and run but it pops out an error

Description

Used the below command to load data:

grunt> REGISTER hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar;
grunt> JSON_DATA = LOAD '/ch07/crimes.json' USING PigStorage() AS (json:chararray);
grunt> STORE JSON_DATA INTO 'esh_pig/crimes_json' USING org.elasticsearch.hadoop.pig.EsStorage('es.input.json=true');

Steps to reproduce

Below is the error:

2017-07-25 12:21:17,674 [Thread-301] WARN  org.apache.hadoop.mapred.LocalJobRunner - job_local1500679296_0008
java.lang.Exception: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found unrecoverable error [Bad Request(400) - [MapperParsingException[failed to parse]; nested: ElasticsearchParseException[Failed to derive xcontent]; ]]; Bailing out..
    at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found unrecoverable error [Bad Request(400) - [MapperParsingException[failed to parse]; nested: ElasticsearchParseException[Failed to derive xcontent]; ]]; Bailing out..
    at org.elasticsearch.hadoop.rest.RestClient.retryFailedEntries(RestClient.java:203)
    at org.elasticsearch.hadoop.rest.RestClient.bulk(RestClient.java:167)
    at org.elasticsearch.hadoop.rest.RestRepository.tryFlush(RestRepository.java:209)
    at org.elasticsearch.hadoop.rest.RestRepository.flush(RestRepository.java:232)
    at org.elasticsearch.hadoop.rest.RestRepository.close(RestRepository.java:250)
    at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.doClose(EsOutputFormat.java:214)
    at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.close(EsOutputFormat.java:196)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.close(PigOutputFormat.java:146)
    at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:670)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:748)
2017-07-25 12:21:22,664 [main] WARN  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.

Version Info

OS: : CentOS 7 JVM : 1.8.0_131 Hadoop: Hadoop 2.7.3 ES : 1.7.1

jbaiera commented 7 years ago

@splikhita I'll need TRACE level logs here to diagnose the exact problem, but it's possible that your data is simply malformed in some spots and Elasticsearch cannot parse it successfully.

splikhita commented 7 years ago

This is the latest Pig Stack Trace I could find sir:

Pig Stack Trace
---------------
ERROR 1003: Unable to find an operator for alias ES

org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1003: Unable to find an operator for alias ES
    at org.apache.pig.PigServer$Graph.buildPlan(PigServer.java:1544)
    at org.apache.pig.PigServer.storeEx(PigServer.java:1029)
    at org.apache.pig.PigServer.store(PigServer.java:997)
    at org.apache.pig.PigServer.openIterator(PigServer.java:910)
    at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:754)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:376)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
    at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
    at org.apache.pig.Main.run(Main.java:565)
    at org.apache.pig.Main.main(Main.java:177)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
jbaiera commented 7 years ago

@splikhita This seems to be a completely different problem than the one you posted above. I took a look around and this error seems to be tied to problems with the Pig Script syntax. Are you still seeing the previous stack trace in this case? Have you modified your script in any way?

splikhita commented 7 years ago

Right now I'm unable to load a json file to elasticsearch using pig. Rest works fine sir.

splikhita commented 7 years ago

I couldn't find any other logs except these on my Home directory. While uploading json it gives me this:

2017-07-25 12:21:17,674 [Thread-301] WARN  org.apache.hadoop.mapred.LocalJobRunner - job_local1500679296_0008
java.lang.Exception: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found unrecoverable error [Bad Request(400) - [MapperParsingException[failed to parse]; nested: ElasticsearchParseException[Failed to derive xcontent]; ]]; Bailing out..
    at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found unrecoverable error [Bad Request(400) - [MapperParsingException[failed to parse]; nested: ElasticsearchParseException[Failed to derive xcontent]; ]]; Bailing out..
    at org.elasticsearch.hadoop.rest.RestClient.retryFailedEntries(RestClient.java:203)
    at org.elasticsearch.hadoop.rest.RestClient.bulk(RestClient.java:167)
    at org.elasticsearch.hadoop.rest.RestRepository.tryFlush(RestRepository.java:209)
    at org.elasticsearch.hadoop.rest.RestRepository.flush(RestRepository.java:232)
    at org.elasticsearch.hadoop.rest.RestRepository.close(RestRepository.java:250)
    at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.doClose(EsOutputFormat.java:214)
    at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.close(EsOutputFormat.java:196)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.close(PigOutputFormat.java:146)
    at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:670)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:748)
2017-07-25 12:21:22,664 [main] WARN  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
jbaiera commented 7 years ago

Right now I'm unable to load a json file to elasticsearch using pig. Rest works fine sir.

Loading JSON to Elasticsearch through ES-Hadoop uses the same Rest Client under the hood. The only thing that is different is how it parses the data (in json mode it just uses the json string as the document).

I couldn't find any other logs except these on my Home directory.

When you launch the Pig script, is it spinning up a job on your Hadoop cluster? Can you pull the logs from the worker nodes? You should be able to configure your Hadoop cluster to increase the logging level of org.elasticsearch.hadoop.rest.commonshttp to TRACE, which means that when the job runs the worker logs will display the Request and Responses from Elasticsearch. This will allow you to see exactly which piece of data was unable to be processed.

grunt> REGISTER hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar;

Have you tried using a newer ES-Hadoop version? The latest release (5.5.1) should be backwards compatible with Elasticsearch 1.7.x.

splikhita commented 7 years ago

I'm not using a cluster, I'm running it on a single node.

jbaiera commented 7 years ago

@splikhita In your pig installation location, there should be a conf directory. Copy the log4j.properties.template file to a new file name and add this line to it: 

log4j.logger.org.elasticsearch.hadoop=trace, A

When you start up pig in local mode, run the command like so: 

pig -v -x local -4 </path/to/that/copied/log4j.properties>

At this point, the shell should be logging the hadoop package at TRACE level into the console that you are running. Once you are in the console, run your job and link the entire contents of the console here.

splikhita commented 7 years ago

I've done what you have said. When the job is run on the console, here is what it gives:

[eshadoop@localhost ~]$  pig -v -x local -4 /usr/local/pig/conf/samplelog4j.properties
17/07/26 16:14:02 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
17/07/26 16:14:02 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
17/07/26 16:14:02 INFO pig.Main: Loaded log4j properties from file: /usr/local/pig/conf/samplelog4j.properties
23   [main] INFO  org.apache.pig.Main  - Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35
17/07/26 16:14:02 INFO pig.Main: Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35
24   [main] INFO  org.apache.pig.Main  - Logging error messages to: /home/eshadoop/pig_1501100042386.log
17/07/26 16:14:02 INFO pig.Main: Logging error messages to: /home/eshadoop/pig_1501100042386.log
41   [main] INFO  org.apache.pig.impl.util.Utils  - Default bootup file /home/eshadoop/.pigbootup not found
17/07/26 16:14:02 INFO util.Utils: Default bootup file /home/eshadoop/.pigbootup not found
17/07/26 16:14:02 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/26 16:14:02 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
173  [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine  - Connecting to hadoop file system at: file:///
17/07/26 16:14:02 INFO executionengine.HExecutionEngine: Connecting to hadoop file system at: file:///
17/07/26 16:14:02 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
301  [main] DEBUG org.apache.pig.tools.grunt.PigCompletor  - Can not find autocomplete file in current directory, skipped
17/07/26 16:14:02 DEBUG grunt.PigCompletor: Can not find autocomplete file in current directory, skipped
grunt>

And when I run it after starting pig i.e., in the grunt mode:

Pig Stack Trace
---------------
ERROR 1000: Error during parsing. Encountered " <IDENTIFIER> "pig "" at line 1, column 1.
Was expecting one of:
    <EOF> 
    "cat" ...
    "clear" ...
    "fs" ...
    "sh" ...
    "cd" ...
    "cp" ...
    "copyFromLocal" ...
    "copyToLocal" ...
    "dump" ...
    "\\d" ...
    "describe" ...
    "\\de" ...
    "aliases" ...
    "explain" ...
    "\\e" ...
    "help" ...
    "history" ...
    "kill" ...
    "ls" ...
    "mv" ...
    "mkdir" ...
    "pwd" ...
    "quit" ...
    "\\q" ...
    "register" ...
    "rm" ...
    "rmf" ...
    "set" ...
    "illustrate" ...
    "\\i" ...
    "run" ...
    "exec" ...
    "%default" ...
    "%declare" ...
    "scriptDone" ...
    "" ...
    "" ...
    <EOL> ...
    ";" ...

org.apache.pig.tools.pigscript.parser.ParseException: Encountered " <IDENTIFIER> "pig "" at line 1, column 1.
Was expecting one of:
    <EOF> 
    "cat" ...
    "clear" ...
    "fs" ...
    "sh" ...
    "cd" ...
    "cp" ...
    "copyFromLocal" ...
    "copyToLocal" ...
    "dump" ...
    "\\d" ...
    "describe" ...
    "\\de" ...
    "aliases" ...
    "explain" ...
    "\\e" ...
    "help" ...
    "history" ...
    "kill" ...
    "ls" ...
    "mv" ...
    "mkdir" ...
    "pwd" ...
    "quit" ...
    "\\q" ...
    "register" ...
    "rm" ...
    "rmf" ...
    "set" ...
    "illustrate" ...
    "\\i" ...
    "run" ...
    "exec" ...
    "%default" ...
    "%declare" ...
    "scriptDone" ...
    "" ...
    "" ...
    <EOL> ...
    ";" ...

    at org.apache.pig.tools.pigscript.parser.PigScriptParser.generateParseException(PigScriptParser.java:1498)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.handle_invalid_command(PigScriptParser.java:1306)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:726)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
    at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
    at org.apache.pig.Main.run(Main.java:565)
    at org.apache.pig.Main.main(Main.java:177)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
jbaiera commented 7 years ago

@splikhita It looks like you're running the Pig command to open the terminal then running the pig command again. What are your commands you're trying to run here?

splikhita commented 7 years ago

Okay I've run the pig command that you asked me to:

pig -v -x local -4 </path/to/that/copied/log4j.properties>

The result for it is as follows:

[eshadoop@localhost ~]$  pig -v -x local -4 /usr/local/pig/conf/samplelog4j.properties
17/07/26 16:14:02 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
17/07/26 16:14:02 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
17/07/26 16:14:02 INFO pig.Main: Loaded log4j properties from file: /usr/local/pig/conf/samplelog4j.properties
23   [main] INFO  org.apache.pig.Main  - Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35
17/07/26 16:14:02 INFO pig.Main: Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35
24   [main] INFO  org.apache.pig.Main  - Logging error messages to: /home/eshadoop/pig_1501100042386.log
17/07/26 16:14:02 INFO pig.Main: Logging error messages to: /home/eshadoop/pig_1501100042386.log
41   [main] INFO  org.apache.pig.impl.util.Utils  - Default bootup file /home/eshadoop/.pigbootup not found
17/07/26 16:14:02 INFO util.Utils: Default bootup file /home/eshadoop/.pigbootup not found
17/07/26 16:14:02 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/26 16:14:02 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
173  [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine  - Connecting to hadoop file system at: file:///
17/07/26 16:14:02 INFO executionengine.HExecutionEngine: Connecting to hadoop file system at: file:///
17/07/26 16:14:02 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
301  [main] DEBUG org.apache.pig.tools.grunt.PigCompletor  - Can not find autocomplete file in current directory, skipped
17/07/26 16:14:02 DEBUG grunt.PigCompletor: Can not find autocomplete file in current directory, skipped
grunt>
jbaiera commented 7 years ago

@splikhita Now that the grunt shell is started, can you run your regular Pig commands and post the full console log here?

splikhita commented 7 years ago

This used to run successfully before but now I get some errors and the job failed.

grunt> REGISTER hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar;
2395066 [main] DEBUG org.apache.pig.PigServer  - Ignoring duplicate registration for jar hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar
17/07/26 16:53:57 DEBUG pig.PigServer: Ignoring duplicate registration for jar hdfs://localhost:9000/lib/elasticsearch-hadoop-2.1.1.jar
grunt> SET default_parallel 5;
grunt> SET pig.splitCombination FALSE;
grunt> SOURCE = load '/ch07/crimes_dataset.csv' using PigStorage(',') as (id:chararray, caseNumber:chararray, date:datetime, block:chararray, iucr:chararray, primaryType:chararray, description:chararray, location:chararray, arrest:boolean, domestic:boolean, lat:double,lon:double);
2420106 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

17/07/26 16:54:22 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

2420107 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

17/07/26 16:54:22 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

2420107 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

17/07/26 16:54:22 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420111 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420115 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420117 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420118 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420118 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420119 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420122 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420123 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/26 16:54:22 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/26 16:54:22 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420159 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420161 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420162 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420163 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420164 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420165 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420167 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

17/07/26 16:54:22 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

2420167 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

17/07/26 16:54:22 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

2420168 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

17/07/26 16:54:22 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))))

2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420171 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420174 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420177 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420178 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420183 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420184 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420190 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2420191 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420192 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2420196 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420204 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:54:22 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2420205 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:54:22 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
grunt> TARGET = foreach SOURCE generate id, caseNumber, date, block, iucr, primaryType, description, location, arrest, domestic, TOTUPLE(lon, lat) AS geoLocation;
2517599 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

17/07/26 16:55:59 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

2517599 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

17/07/26 16:55:59 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

2517600 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

17/07/26 16:55:59 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

2517602 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517603 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517605 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:55:59 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517606 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517606 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517607 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517609 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517610 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517612 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:55:59 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517613 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517615 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517618 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:55:59 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517619 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517620 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517621 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517622 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517623 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517624 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517624 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517624 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517624 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517633 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517634 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517635 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:55:59 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517637 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

17/07/26 16:56:00 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

2517637 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

17/07/26 16:56:00 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

2517637 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

17/07/26 16:56:00 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))))

2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517639 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517641 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:56:00 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517642 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517644 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517646 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:56:00 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517647 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517648 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517650 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:56:00 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2517651 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:56:00 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
splikhita commented 7 years ago 
grunt> STORE TARGET INTO 'esh_pig/crimes' USING org.elasticsearch.hadoop.pig.EsStorage('es.http.timeout = 5m', 'es.index.auto.create = true', 'es.mapping.names=arrest:isArrest, domestic:isDomestic', 'es.mapping.id=id', 'es.mapping.pig.tuple.use.field.names=true');
2712421 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

17/07/26 16:59:14 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

2712421 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

17/07/26 16:59:14 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

2712422 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

17/07/26 16:59:14 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712425 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712428 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712429 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712431 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712433 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712434 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712435 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712436 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712436 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712436 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712438 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712438 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712438 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712439 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/26 16:59:14 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/26 16:59:14 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
2712463 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712464 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712465 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712466 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712467 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712468 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712469 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712471 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

17/07/26 16:59:14 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

2712471 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

17/07/26 16:59:14 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

2712471 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

17/07/26 16:59:14 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id'))) (STATEMENT SOURCE (load '/ch07/crimes_dataset.csv' (FUNC PigStorage ',') (as (FIELD_DEF id chararray) (FIELD_DEF caseNumber chararray) (FIELD_DEF date datetime) (FIELD_DEF block chararray) (FIELD_DEF iucr chararray) (FIELD_DEF primaryType chararray) (FIELD_DEF description chararray) (FIELD_DEF location chararray) (FIELD_DEF arrest boolean) (FIELD_DEF domestic boolean) (FIELD_DEF lat double) (FIELD_DEF lon double)))) (STATEMENT TARGET (foreach SOURCE (FOREACH_PLAN_SIMPLE (generate id caseNumber date block iucr primaryType description location arrest domestic (FUNC_EVAL TOTUPLE lon lat) (FIELD_DEF geoLocation))))) (STATEMENT (STORE TARGET 'esh_pig/crimes' (FUNC org . elasticsearch . hadoop . pig . EsStorage 'es.http.timeout = 5m' 'es.index.auto.create = true' 'es.mapping.names=arrest:isArrest, domestic:isDomestic' 'es.mapping.id=id' 'es.mapping.pig.tuple.use.field.names=true'))))

2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712473 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712475 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712476 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712477 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712479 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712479 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712479 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712480 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712481 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes_dataset.csv
17/07/26 16:59:14 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes_dataset.csv
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712483 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712484 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712486 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage  - Using pre-defined writer serializer [org.elasticsearch.hadoop.pig.PigValueWriter] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined writer serializer [org.elasticsearch.hadoop.pig.PigValueWriter] as default
2712486 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage  - Using pre-defined reader serializer [org.elasticsearch.hadoop.pig.PigValueReader] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined reader serializer [org.elasticsearch.hadoop.pig.PigValueReader] as default
2712486 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage  - Using pre-defined field extractor [org.elasticsearch.hadoop.pig.PigFieldExtractor] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined field extractor [org.elasticsearch.hadoop.pig.PigFieldExtractor] as default
2712486 [main] WARN  org.elasticsearch.hadoop.mr.EsOutputFormat  - Speculative execution enabled for reducer - consider disabling it to prevent data corruption
17/07/26 16:59:14 WARN mr.EsOutputFormat: Speculative execution enabled for reducer - consider disabling it to prevent data corruption
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712487 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712489 [main] INFO  org.apache.pig.tools.pigstats.ScriptState  - Pig features used in the script: UNKNOWN
17/07/26 16:59:14 INFO pigstats.ScriptState: Pig features used in the script: UNKNOWN
17/07/26 16:59:14 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/26 16:59:14 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/26 16:59:14 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2712523 [main] INFO  org.apache.pig.data.SchemaTupleBackend  - Key [pig.schematuple] was not set... will not generate code.
17/07/26 16:59:14 INFO data.SchemaTupleBackend: Key [pig.schematuple] was not set... will not generate code.
2712523 [main] INFO  org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer  - {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, ConstantCalculator, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, PartitionFilterOptimizer, PredicatePushdownOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter]}
17/07/26 16:59:14 INFO optimizer.LogicalPlanOptimizer: {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, ConstantCalculator, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, PartitionFilterOptimizer, PredicatePushdownOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter]}
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.data.SchemaTupleFrontend  - Registering Schema for generation [{double,double}] with id [0] and context: UDF
17/07/26 16:59:14 DEBUG data.SchemaTupleFrontend: Registering Schema for generation [{double,double}] with id [0] and context: UDF
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712525 [main] DEBUG org.apache.pig.data.SchemaTupleFrontend  - Registering Schema for generation [{(double,double)}] with id [1] and context: UDF
17/07/26 16:59:14 DEBUG data.SchemaTupleFrontend: Registering Schema for generation [{(double,double)}] with id [1] and context: UDF
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712526 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712527 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712527 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712527 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712527 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.data.SchemaTupleFrontend  - Registering Schema for generation [{chararray,chararray,datetime,chararray,chararray,chararray,chararray,chararray,boolean,boolean,(double,double)}] with id [2] and context: FOREACH
17/07/26 16:59:14 DEBUG data.SchemaTupleFrontend: Registering Schema for generation [{chararray,chararray,datetime,chararray,chararray,chararray,chararray,chararray,boolean,boolean,(double,double)}] with id [2] and context: FOREACH
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 30 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 30 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 5 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 5 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 25 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 25 Bag: 120 tuple: 110
2712528 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 110 Bag: 120 tuple: 110
17/07/26 16:59:14 DEBUG schema.Schema$FieldSchema: t: 110 Bag: 120 tuple: 110
2712529 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler  - File concatenation threshold: 100 optimistic? false
17/07/26 16:59:14 INFO mapReduceLayer.MRCompiler: File concatenation threshold: 100 optimistic? false
2712529 [main] DEBUG org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.SampleOptimizer  - Not a sampling job.
17/07/26 16:59:14 DEBUG mapReduceLayer.SampleOptimizer: Not a sampling job.
2712529 [main] TRACE org.apache.pig.backend.hadoop.executionengine.util.SecondaryKeyOptimizerUtil  - Entering SecondaryKeyOptimizerUtil.addSecondaryKeySort
17/07/26 16:59:14 TRACE util.SecondaryKeyOptimizerUtil: Entering SecondaryKeyOptimizerUtil.addSecondaryKeySort
2712530 [main] DEBUG org.apache.pig.backend.hadoop.executionengine.util.SecondaryKeyOptimizerUtil  - Cannot find POLocalRearrange or POUnion in map leaf, skip secondary key optimizing
17/07/26 16:59:14 DEBUG util.SecondaryKeyOptimizerUtil: Cannot find POLocalRearrange or POUnion in map leaf, skip secondary key optimizing
2712530 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer  - MR plan size before optimization: 1
17/07/26 16:59:14 INFO mapReduceLayer.MultiQueryOptimizer: MR plan size before optimization: 1
2712530 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer  - MR plan size after optimization: 1
17/07/26 16:59:14 INFO mapReduceLayer.MultiQueryOptimizer: MR plan size after optimization: 1
17/07/26 16:59:14 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/26 16:59:14 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/26 16:59:14 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2712541 [main] INFO  org.apache.pig.tools.pigstats.mapreduce.MRScriptState  - Pig script settings are added to the job
17/07/26 16:59:14 INFO mapreduce.MRScriptState: Pig script settings are added to the job
2712541 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler  - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
17/07/26 16:59:14 INFO mapReduceLayer.JobControlCompiler: mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2712553 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage  - Using pre-defined writer serializer [org.elasticsearch.hadoop.pig.PigValueWriter] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined writer serializer [org.elasticsearch.hadoop.pig.PigValueWriter] as default
2712553 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage  - Using pre-defined reader serializer [org.elasticsearch.hadoop.pig.PigValueReader] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined reader serializer [org.elasticsearch.hadoop.pig.PigValueReader] as default
2712553 [main] DEBUG org.elasticsearch.hadoop.pig.EsStorage  - Using pre-defined field extractor [org.elasticsearch.hadoop.pig.PigFieldExtractor] as default
17/07/26 16:59:14 DEBUG pig.EsStorage: Using pre-defined field extractor [org.elasticsearch.hadoop.pig.PigFieldExtractor] as default
2712553 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler  - Setting up single store job
17/07/26 16:59:14 INFO mapReduceLayer.JobControlCompiler: Setting up single store job
2712554 [main] DEBUG org.apache.pig.data.SchemaTupleFrontend  - Temporary directory for generated code created: /tmp/1501102754918-0
17/07/26 16:59:14 DEBUG data.SchemaTupleFrontend: Temporary directory for generated code created: /tmp/1501102754918-0
2712554 [main] INFO  org.apache.pig.data.SchemaTupleFrontend  - Key [pig.schematuple] is false, will not generate code.
17/07/26 16:59:14 INFO data.SchemaTupleFrontend: Key [pig.schematuple] is false, will not generate code.
2712554 [main] INFO  org.apache.pig.data.SchemaTupleFrontend  - Starting process to move generated code to distributed cacche
17/07/26 16:59:14 INFO data.SchemaTupleFrontend: Starting process to move generated code to distributed cacche
2712554 [main] INFO  org.apache.pig.data.SchemaTupleFrontend  - Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /tmp/1501102754918-0
17/07/26 16:59:14 INFO data.SchemaTupleFrontend: Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /tmp/1501102754918-0
2712562 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - 1 map-reduce job(s) waiting for submission.
17/07/26 16:59:14 INFO mapReduceLayer.MapReduceLauncher: 1 map-reduce job(s) waiting for submission.
2712562 [main] DEBUG org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - Failed to get job tracker location.
17/07/26 16:59:14 DEBUG mapReduceLayer.MapReduceLauncher: Failed to get job tracker location.
2712563 [JobControl] DEBUG org.apache.pig.backend.hadoop23.PigJobControl  - Checking state of job job name: PigLatin:DefaultJobName
job id: job_pigexec_0
job state:  WAITING
job mapred id:  null
job message:    just initialized
job has no depending job:   

17/07/26 16:59:14 DEBUG hadoop23.PigJobControl: Checking state of job job name: PigLatin:DefaultJobName
job id: job_pigexec_0
job state:  WAITING
job mapred id:  null
job message:    just initialized
job has no depending job:   

17/07/26 16:59:14 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2712568 [JobControl] WARN  org.elasticsearch.hadoop.mr.EsOutputFormat  - Speculative execution enabled for reducer - consider disabling it to prevent data corruption
17/07/26 16:59:14 WARN mr.EsOutputFormat: Speculative execution enabled for reducer - consider disabling it to prevent data corruption
17/07/26 16:59:14 WARN mapreduce.JobResourceUploader: No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
17/07/26 16:59:14 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-eshadoop/mapred/staging/eshadoop427912082/.staging/job_local427912082_0005
17/07/26 16:59:14 INFO jobcontrol.ControlledJob: PigLatin:DefaultJobName got an error while submitting 
org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
    at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
    at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
    at java.lang.Thread.run(Thread.java:748)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
    ... 18 more
2712680 [JobControl] DEBUG org.apache.pig.backend.hadoop23.PigJobControl  - Checking state of job job name: PigLatin:DefaultJobName
job id: job_pigexec_0
job state:  FAILED
job mapred id:  job_local427912082_0005
job message:    org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
    at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
    at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
    at java.lang.Thread.run(Thread.java:748)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
    ... 18 more

job has no depending job:   

17/07/26 16:59:15 DEBUG hadoop23.PigJobControl: Checking state of job job name: PigLatin:DefaultJobName
job id: job_pigexec_0
job state:  FAILED
job mapred id:  job_local427912082_0005
job message:    org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
    at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
    at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
    at java.lang.Thread.run(Thread.java:748)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
    ... 18 more

job has no depending job:   

2712781 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - HadoopJobId: job_local427912082_0005
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: HadoopJobId: job_local427912082_0005
2712781 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - Processing aliases SOURCE,TARGET
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: Processing aliases SOURCE,TARGET
2712781 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - detailed locations: M: SOURCE[9,9],TARGET[-1,-1] C:  R: 
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: detailed locations: M: SOURCE[9,9],TARGET[-1,-1] C:  R: 
2712783 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - 0% complete
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: 0% complete
2712785 [main] WARN  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
17/07/26 16:59:15 WARN mapReduceLayer.MapReduceLauncher: Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
2712785 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - job job_local427912082_0005 has failed! Stop running all dependent jobs
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: job job_local427912082_0005 has failed! Stop running all dependent jobs
2712785 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - 100% complete
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: 100% complete
17/07/26 16:59:15 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2712786 [main] ERROR org.apache.pig.tools.pigstats.PigStats  - ERROR 0: java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING
17/07/26 16:59:15 ERROR pigstats.PigStats: ERROR 0: java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING
2712786 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil  - 1 map reduce job(s) failed!
17/07/26 16:59:15 ERROR mapreduce.MRPigStatsUtil: 1 map reduce job(s) failed!
2712787 [main] INFO  org.apache.pig.tools.pigstats.mapreduce.SimplePigStats  - Script Statistics: 

HadoopVersion   PigVersion  UserId  StartedAt   FinishedAt  Features
2.7.3   0.15.0  eshadoop    2017-07-26 16:59:14 2017-07-26 16:59:15 UNKNOWN

Failed!

Failed Jobs:
JobId   Alias   Feature Message Outputs
job_local427912082_0005 SOURCE,TARGET   MAP_ONLY    Message: org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
    at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
    at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
    at java.lang.Thread.run(Thread.java:748)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
    ... 18 more
    esh_pig/crimes,

Input(s):
Failed to read data from "/ch07/crimes_dataset.csv"

Output(s):
Failed to produce result in "esh_pig/crimes"

Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0

Job DAG:
job_local427912082_0005

17/07/26 16:59:15 INFO mapreduce.SimplePigStats: Script Statistics: 

HadoopVersion   PigVersion  UserId  StartedAt   FinishedAt  Features
2.7.3   0.15.0  eshadoop    2017-07-26 16:59:14 2017-07-26 16:59:15 UNKNOWN

Failed!

Failed Jobs:
JobId   Alias   Feature Message Outputs
job_local427912082_0005 SOURCE,TARGET   MAP_ONLY    Message: org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:279)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
    at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
    at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
    at java.lang.Thread.run(Thread.java:748)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/ch07/crimes_dataset.csv
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:265)
    ... 18 more
    esh_pig/crimes,

Input(s):
Failed to read data from "/ch07/crimes_dataset.csv"

Output(s):
Failed to produce result in "esh_pig/crimes"

Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0

Job DAG:
job_local427912082_0005

2712788 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher  - Failed!
17/07/26 16:59:15 INFO mapReduceLayer.MapReduceLauncher: Failed!
grunt>
splikhita commented 7 years ago

There is a lot of data in the dataset. So there are more logs. Apologies!!

jbaiera commented 7 years ago

@splikhita Log volume is not a big deal. If you want you can always post the logs to a gist or a pastebin.

The error you're running into seems to be this:

Failed to read data from "/ch07/crimes_dataset.csv"

I'm assuming this data is normally stored on HDFS? You'll have to specify an absolute path for the file, and to make sure that the file exists before running the job.

splikhita commented 7 years ago

The file exists in HDFS:

[eshadoop@localhost ~]$ hadoop fs -ls /ch07
Found 2 items
-rw-r--r--   1 eshadoop supergroup       6321 2017-07-26 11:49 /ch07/crimes.json
-rw-r--r--   1 eshadoop supergroup     131157 2017-07-26 16:48 /ch07/crimes_dataset.csv
jbaiera commented 7 years ago

@splikhita You might have to specify the file with the full HDFS path: hdfs://<hdfsNameNodeAddress>:<hdfsNameNodePort>/ch07/crimes.json

splikhita commented 7 years ago

Tried it @jbaiera, it's the same:

grunt> JSON_DATA = LOAD 'hdfs://localhost:9000/ch07/crimes.json' USING PigStorage() AS (json:chararray);
76190 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/26 17:35:36 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

76191 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/26 17:35:36 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

76191 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/26 17:35:36 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

76194 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 17:35:36 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
76198 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes.json
17/07/26 17:35:36 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes.json
17/07/26 17:35:36 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/26 17:35:36 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/26 17:35:36 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
76230 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 17:35:36 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
76246 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for hdfs://localhost:9000/ch07/crimes.json
17/07/26 17:35:36 DEBUG builtin.JsonMetadata: Could not find schema file for hdfs://localhost:9000/ch07/crimes.json
76248 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/26 17:35:36 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

76248 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/26 17:35:36 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

76248 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/26 17:35:36 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD '/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'hdfs://localhost:9000/ch07/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

76250 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 17:35:36 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
76253 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for /ch07/crimes.json
17/07/26 17:35:36 DEBUG builtin.JsonMetadata: Could not find schema file for /ch07/crimes.json
76254 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/26 17:35:36 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
76282 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for hdfs://localhost:9000/ch07/crimes.json
17/07/26 17:35:36 DEBUG builtin.JsonMetadata: Could not find schema file for hdfs://localhost:9000/ch07/crimes.json
jbaiera commented 7 years ago

@splikhita Can you try it with the file copied to your local machine instead of HDFS?

splikhita commented 7 years ago

No luck sir.

17/07/26 17:42:18 DEBUG builtin.JsonMetadata: Could not find schema file for /home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json
splikhita commented 7 years ago

I used this command for the above result:

JSON_DATA = LOAD '/home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' USING PigStorage() AS (json:chararray);
jbaiera commented 7 years ago

@splikhita This works for me if I preface the path with file://, try with file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json to see if that helps. If not, either the file is simply missing or you should open an issue with Pig as that does not seem to be related to the connector.

splikhita commented 7 years ago

Gives me this error:

grunt> JSON_DATA = LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' USING PigStorage() AS (json:chararray);
152475 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/27 12:57:07 DEBUG parser.QueryParserDriver: Original macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

152475 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/27 12:57:07 DEBUG parser.QueryParserDriver: macro AST after import:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

152475 [main] DEBUG org.apache.pig.parser.QueryParserDriver  - Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/27 12:57:07 DEBUG parser.QueryParserDriver: Resulting macro AST:
(QUERY (STATEMENT JSON_DATA (LOAD 'file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))) (STATEMENT JSON_DATA (LOAD 'file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json' (FUNC PigStorage) (AS (FIELD_DEF json chararray)))))

17/07/27 12:57:07 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
17/07/27 12:57:07 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/27 12:57:07 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
152479 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/27 12:57:07 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
152486 [main] DEBUG org.apache.pig.builtin.JsonMetadata  - Could not find schema file for file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json
17/07/27 12:57:07 DEBUG builtin.JsonMetadata: Could not find schema file for file:///home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json
17/07/27 12:57:07 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
17/07/27 12:57:07 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
17/07/27 12:57:07 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
152516 [main] DEBUG org.apache.pig.impl.logicalLayer.schema.Schema$FieldSchema  - t: 55 Bag: 120 tuple: 110
17/07/27 12:57:07 DEBUG schema.Schema$FieldSchema: t: 55 Bag: 120 tuple: 110
152520 [main] ERROR org.apache.pig.tools.grunt.Grunt  - ERROR 1200: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
17/07/27 12:57:07 ERROR grunt.Grunt: ERROR 1200: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
152520 [main] ERROR org.apache.pig.tools.grunt.Grunt  - Failed to parse: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
    at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:201)
    at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707)
    at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680)
    at org.apache.pig.PigServer.registerQuery(PigServer.java:623)
    at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1082)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:505)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
    at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
    at org.apache.pig.Main.run(Main.java:565)
    at org.apache.pig.Main.main(Main.java:177)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.IllegalArgumentException: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:648)
    at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:82)
    at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:606)
    at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)
    at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)
    at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
    at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1426)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.isContainer(HDataStorage.java:200)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:128)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:144)
    at org.apache.pig.impl.io.FileLocalizer.fullPath(FileLocalizer.java:327)
    at org.apache.pig.builtin.JsonMetadata.findMetaFile(JsonMetadata.java:111)
    at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:189)
    at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:538)
    at org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:175)
    at org.apache.pig.newplan.logical.relational.LOLoad.<init>(LOLoad.java:89)
    at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:901)
    at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3568)
    at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1625)
    at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
    at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
    at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
    at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
    ... 16 more

17/07/27 12:57:07 ERROR grunt.Grunt: Failed to parse: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
    at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:201)
    at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707)
    at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680)
    at org.apache.pig.PigServer.registerQuery(PigServer.java:623)
    at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1082)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:505)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
    at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
    at org.apache.pig.Main.run(Main.java:565)
    at org.apache.pig.Main.main(Main.java:177)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.IllegalArgumentException: Wrong FS: file://home/eshadoop/Downloads/eshadoop-master/ch07/data/crimes.json, expected: file:///
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:648)
    at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:82)
    at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:606)
    at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)
    at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)
    at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
    at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1426)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.isContainer(HDataStorage.java:200)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:128)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:144)
    at org.apache.pig.impl.io.FileLocalizer.fullPath(FileLocalizer.java:327)
    at org.apache.pig.builtin.JsonMetadata.findMetaFile(JsonMetadata.java:111)
    at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:189)
    at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:538)
    at org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:175)
    at org.apache.pig.newplan.logical.relational.LOLoad.<init>(LOLoad.java:89)
    at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:901)
    at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3568)
    at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1625)
    at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
    at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
    at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
    at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
    ... 16 more

Details also at logfile: /home/eshadoop/pig_1501174475369.log
jbaiera commented 7 years ago

@splikhita Unfortunately it looks like this a problem with your version of Pig. I would move this discussion to the Pig Mailing list to see if they have any input. I'm going to close this out for now.