UrbanCCD-UChicago / plenario

API for geospatial and time aggregation across multiple open datasets.
http://plenar.io
MIT License
154 stars 42 forks source link

Filtering by dataset name `land_use_permits` returns 500 Internal Server Error #315

Closed brlodi closed 7 years ago

brlodi commented 7 years ago

Providing the dataset_name query parameter with value land_use_permits, or dataset_name__in with that as the only element*, causes an error. The dataset name does exist, and appears in the unfiltered output from /datasets.

http://plenar.io/v1/api/datasets?dataset_name=land_use_permits
http://plenar.io/v1/api/timeseries?dataset_name=land_use_permits

This also happens with the dataset name usa_nursing_home_ratings, and possibly others.

* If other dataset names are provided that do not exhibit this issue, the expected successful response is returned for the others, but without the problematic dataset

brlodi commented 7 years ago

Two more, these from the /grid endpoint:

In this case, those trailing underscores are very suspicious

brlodi commented 7 years ago

Another problem endpoint: /timeseries. I'm seeing a 65% failure rate querying single datasets.

ALL of these fail with a 500 response if passed as dataset_name:

2001_campaign_expenditures
2003_campaign_contributions
2003_campaign_expenditures
2005_campaign_contributions
2005_campaign_expenditures
2009_campaign_contributions
2009_campaign_expenditures
2010_2014_restaurant_applications
2013_campaign_contributions
2013_campaign_expenditures
2013_ecad_commercial_portfolio_manager_reported_da
2013_ecad_multi_family_energy_audit_and_eui_data
2013_green_taxi_trip_data
2014_green_taxi_trip_data
2016_fire_data
2016_green_taxi_trip_data
311_service_requests_2009
311_service_requests_for_2006
311_service_requests_for_2007
311_service_requests_for_2008
advantage_after_school_program
apd_incident_extract_2008
apd_incident_extract_2009
apd_incident_extract_2010
apd_incident_extract_2011
apd_incident_extract_ytd
austin_crime_map
average_daily_traffic_counts
beach_lab_data
bird_conservation_areas
bristol_crime_stats
building_permits_current
building_permits_older_than_5_years
capital_improvement_passthrough_petitions
capital_projects_nys_thruway_authority_capital_pro
cdph_environmental_hold_on_city_issued_permits_and
cdph_storage_tanks
chicago_redlight_tickets_csv
city_of_champaign_historic_landmarks
code_violation_cases
credit_access_businesses
crime_csv
crime_incident_reports
crimes_2012_2015
cta_ridership_avg_weekday_bus_stop_boardings_in_oc
cta_ridership_for_average_weekday_in_october_2012
dallas_police_public_data_rms_incidents_with_geolo
economic_development_compliance_chapter_380_agreem
edmonton_traffic_disruptions
electrical_permits_3_6_years_old
electrical_permits_current
electrical_permits_older_than_6_years
environmental_control_asbestos_abatement_permits_2
environmental_control_asbestos_demolition_permits_
eviction_notices
flu_shot_clinic_locations_2013_standard_format
food_service_establishment_last_inspection
geocoded_planning_applications2010_2014
graffiti_30_days
iema_dental_facilities_in_illinois
iema_non_dental_facilities_in_illinois_with_radiat
individual_landmarks
la_building_and_safety_permits
land_use_permits
landlord_utility_passthroughs
lapd_crime_and_collision_raw_data_2014
lapd_crime_and_collision_raw_data_for_2013
liquor_authority_quarterly_list_of_active_licenses
market_street_hub
mayor_s_24_hour_hotline_service_requests
mayors_24_hour_hotline_cases_created_last_90_days
mobile_food_schedule
new_hampshire_final_csv
new_york_s_great_appliance_swap_out
nola_permits
nyc_service_volunteer_opportunities
open_business_locations_san_francisco
operating_and_maintenance_petitions
ppd_crime_incidents_2012_2014
red_light_camera_locations
sfpd_incident_all_datetime_csv
sfpd_incidents_from_1_january_2003
speed_camera_locations
street_tree_list
trade_permits_current
universal_pre_k_upk_school_locations
usa_nursing_home_ratings
water_quality_sampling_data

These are the ones that work:

2001_campaign_contributions
311_non_emergency_complaints
311_service_requests_abandoned_vehicles
311_service_requests_alley_lights_out
311_service_requests_garbage_carts
311_service_requests_graffiti_removal
311_service_requests_pot_holes_reported
311_service_requests_rodent_baiting
311_service_requests_sanitation_code_complaints
311_service_requests_street_lights_all_out
311_service_requests_street_lights_one_out
311_service_requests_tree_debris
311_service_requests_tree_trims
311_service_requests_vacant_and_abandoned_building
311_unified_data
arrests
building_permits
building_violations
business_licenses
business_licenses_current_liquor_and_public_places
cdph_asbestos_and_demolition_notification
cdph_environmental_complaints
cdph_environmental_inspections
cdph_environmental_permits
child_care_regulated_programs
city_of_atlanta_relay_bike_share_stations
cook_county_recorder_of_deeds_foreclosures_2011_co
cook_county_recorder_of_deeds_foreclosures_2012_ja
cook_county_recorder_of_deeds_mortgages_2011_compl
cook_county_recorder_of_deeds_mortgages_2012_janua
crimes_2001_to_present
curb_ramps
divvy_trips
dpd_all_crime_incidents_2009_present_provisional
food_inspections
historic_journey_times
listing_of_active_businesses
micro_market_recovery_program_cases
micro_market_recovery_program_permits
micro_market_recovery_program_violations_and_inspe
non_traffic_citations
nypd_motor_vehicle_collisions
ordinance_violations
police_incident_blotter_archive
relocated_vehicles
roadworks
state_university_construction_fund_sucf_contracts_
transportation_department_permits
west_nile_virus_wnv_mosquito_test_results