search

Esri / gis-tools-for-hadoop

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.
http://esri.github.io/gis-tools-for-hadoop/
Apache License 2.0
519 stars 254 forks source link

How can I limit a Hive spatial binning query to a specific map extent? #59

Closed mattgray1981 closed 4 years ago

mattgray1981 commented 6 years ago

I'm trying to do a HQL query based off a map extent. I cant get this to work, what am I doing wrong? I'm using the taxi_demo in the ESRI example.

SELECT ST_Bin(0.001, ST_Point(dropoff_longitude,dropoff_latitude)) bin_id, *FROM taxi_demo WHERE ST_Contains(ST_Envelope(-8238484.195726455, 4969891.9664984355, -8235431.491909235, 4971962.932233592), ST_Point(dropoff_longitude,dropoff_latitude))

Am I doing something wrong or fat fingering something? It says: No matching method for class com.esri.hadoop.hive.ST_Envelope with (double, double, double, double). Possible choices: FUNC(binary)**

capture

randallwhitman commented 6 years ago

What versions of Spatial Framework for Hadoop, Geometry, Hive, and Hadoop?

mattgray1981 commented 6 years ago

Thanks, for the quick response. esri-geometry-api-1.2.1,spatial-sdk-hive-1.1.1, spatial-sdk-json-1.1.1, HDFS 2.7.1.2.3.4.29 , MapReduce2 2.7.1.2.3.4.29 , Hive 1.2.1.2.3.4.29

From: Randall Whitman [mailto:notifications@github.com] Sent: Tuesday, November 14, 2017 12:05 PM To: Esri/gis-tools-for-hadoop gis-tools-for-hadoop@noreply.github.com Cc: GRAY, MATTHEW mg779m@att.com; Author author@noreply.github.com Subject: Re: [Esri/gis-tools-for-hadoop] How can I limit a Hive spatial binning query to a specific map extent? (#59)

What versions of Spatial Framework for Hadoop, Geometry, Hive, and Hadoop?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Esri_gis-2Dtools-2Dfor-2Dhadoop_issues_59-23issuecomment-2D344345492&d=DwMCaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=h_PoBEA56u68WC4WDcu6lQ&m=N8ywBjiuSCNcPWfh0YLfXBmWI0w-SYDOrgiWinzTjOw&s=OqP0q2bRMy4LzaNavTI_1eCipHskIVr2ZVA4LDPYmrE&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZj00JKMD-5FnTIQ0MjbhgRpe1Yh-5FeLbE5ks5s2dZZgaJpZM4QTc4M&d=DwMCaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=h_PoBEA56u68WC4WDcu6lQ&m=N8ywBjiuSCNcPWfh0YLfXBmWI0w-SYDOrgiWinzTjOw&s=3PT1wHsmlGgcR4laFM4XvGnYZZ92GxsG8tq2xhF-Hi4&e=.

mattgray1981 commented 6 years ago

Thanks, for the quick response. esri-geometry-api-1.2.1,spatial-sdk-hive-1.1.1, spatial-sdk-json-1.1.1, HDFS 2.7.1.2.3.4.29 , MapReduce2 2.7.1.2.3.4.29 , Hive 1.2.1.2.3.4.29

randallwhitman commented 6 years ago

What happens if you try with Spatial Framework for Hadoop v2.0 (or v1.2), available in the releases on GitHub? (Spatial Framework v2 will also require Geometry v2.) Also you can try building from source with maven -Phadoop-2.7 -Phive-1.2 package.

randallwhitman commented 6 years ago

Also what add jar statements did you use?

mattgray1981 commented 6 years ago

add jar hdfs:///sandbox/sandbox21/libs/esri-geometry-api-1.2.1.jar; add jar hdfs:///sandbox/sandbox21/libs/spatial-sdk-hive-1.1.1-SNAPSHOT.jar; add jar hdfs:///sandbox/sandbox21/libs/spatial-sdk-json-1.1.1-SNAPSHOT.jar; add jar hdfs:///sandbox/sandbox21/libs/2017/spatial-sdk-hadoop.jar;

From: Randall Whitman [mailto:notifications@github.com] Sent: Tuesday, November 14, 2017 5:52 PM To: Esri/gis-tools-for-hadoop gis-tools-for-hadoop@noreply.github.com Cc: GRAY, MATTHEW mg779m@att.com; Author author@noreply.github.com Subject: Re: [Esri/gis-tools-for-hadoop] How can I limit a Hive spatial binning query to a specific map extent? (#59)

Also what add jar statements did you use?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Esri_gis-2Dtools-2Dfor-2Dhadoop_issues_59-23issuecomment-2D344439559&d=DwMCaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=h_PoBEA56u68WC4WDcu6lQ&m=qs55q_ULGzvAK9i0rxU8JODr_ovLNmIWGNa82_Xn-jg&s=tjoD5AePHfiqOo_ZDJp7pivafCqWGYkqRUgo1mqNucQ&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZj00L6R0dl9vvnwpRsmZpAPJRgvdPYgks5s2ieygaJpZM4QTc4M&d=DwMCaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=h_PoBEA56u68WC4WDcu6lQ&m=qs55q_ULGzvAK9i0rxU8JODr_ovLNmIWGNa82_Xn-jg&s=X6gOcZoNjcV99kMO_DWn6TteIYvL1a8J-rBpF-lu7z4&e=.

mattgray1981 commented 6 years ago

add jar hdfs:///sandbox/sandbox21/libs/esri-geometry-api-1.2.1.jar; add jar hdfs:///sandbox/sandbox21/libs/spatial-sdk-hive-1.1.1-SNAPSHOT.jar; add jar hdfs:///sandbox/sandbox21/libs/spatial-sdk-json-1.1.1-SNAPSHOT.jar; add jar hdfs:///sandbox/sandbox21/libs/2017/spatial-sdk-hadoop.jar;

randallwhitman commented 6 years ago

Use spatial-sdk-hive and spatial-sdk-json, not spatial-sdk-hadoop. (Alternately, use the all-in-one rather than the per-module, but not all 3.)