simonw / ca-fires-history

Tracking fire data from www.fire.ca.gov
201 stars 48 forks source link

Update scraper to new source #5

Closed simonw closed 1 year ago

simonw commented 1 year ago

This URL started breaking a while ago: https://www.fire.ca.gov/umbraco/Api/IncidentApi/GetIncidents

simonw commented 1 year ago

This seems to work:

curl 'https://www.fire.ca.gov/api/sitecore/Incident/GetFiresForMap' \
  -X POST --data-raw 'showFeatured=False'

Piped through jq gives me:

[
  {
    "Name": "Wildcat Fire",
    "Updated": "2023-06-21",
    "Started": "2023-06-16",
    "AdminUnit": "Lead agency: United States Forest Service-Sierra National Forest",
    "County": "Fresno",
    "Location": "Forest Service Road 10S069 and Trimmer Springs Road, Pine Flat ",
    "AcresBurned": 0,
    "PercentContained": 0,
    "Longitude": -119.2043,
    "Latitude": 36.9351,
    "Type": null,
    "UniqueId": "8fd8a93e-1959-4382-9861-979a77194624",
    "Url": "/incidents/2023/6/16/wildcat-fire/",
    "StartedDateOnly": null,
    "IsActive": true
  },
  {
    "Name": "Balfour Fire",
    "Updated": "2023-06-25",
    "Started": "2023-06-25",
    "AdminUnit": "CAL FIRE Santa Clara Unit\r\nand Contra Costa County Fire Protection District",
    "County": "Contra Costa",
    "Location": "Deer Valley Road and Balfour Road in Contra Costa County",
    "AcresBurned": 73,
    "PercentContained": 90,
    "Longitude": -121.7676,
    "Latitude": 37.9143,
    "Type": null,
    "UniqueId": "fa24f204-d45e-479f-8437-4ce009874df9",
    "Url": "/incidents/2023/6/25/balfour-fire/",
    "StartedDateOnly": null,
    "IsActive": true
  },
  {
    "Name": "Crane Fire",
    "Updated": "2023-06-28",
    "Started": "2023-06-27",
    "AdminUnit": "CAL FIRE Fresno-Kings Unit",
    "County": "Fresno",
    "Location": "Crane Lane and Ackers Lane, near Squaw Valley ",
    "AcresBurned": 24,
    "PercentContained": 55,
    "Longitude": -119.0137,
    "Latitude": 36.8675,
    "Type": null,
    "UniqueId": "417b7148-f644-4919-880f-8d529e1f8b95",
    "Url": "/incidents/2023/6/27/crane-fire/",
    "StartedDateOnly": null,
    "IsActive": true
  },
  {
    "Name": "Juniper Fire",
    "Updated": "2023-06-28",
    "Started": "2023-06-27",
    "AdminUnit": "CAL FIRE Riverside Unit",
    "County": "Riverside",
    "Location": "Juniper Road and Santa Rosa Road, west of the City of Perris",
    "AcresBurned": 55,
    "PercentContained": 5,
    "Longitude": -117.330286,
    "Latitude": 33.787329,
    "Type": null,
    "UniqueId": "1c823bea-8d80-4560-9888-91fe81366451",
    "Url": "/incidents/2023/6/27/juniper-fire/",
    "StartedDateOnly": null,
    "IsActive": true
  },
  {
    "Name": "Nice Fire",
    "Updated": "2023-06-28",
    "Started": "2023-06-27",
    "AdminUnit": "CAL FIRE San Bernardino Unit",
    "County": "San Bernardino",
    "Location": "Nice Ave and Amethyst Ave, Mentone ",
    "AcresBurned": 90,
    "PercentContained": 50,
    "Longitude": -117.0957,
    "Latitude": 34.0568,
    "Type": null,
    "UniqueId": "c56682cd-d6d6-47fe-bcaa-e0f77339f604",
    "Url": "/incidents/2023/6/27/nice-fire/",
    "StartedDateOnly": null,
    "IsActive": true
  }
]
simonw commented 1 year ago

The schema has changed. I'm going to record this in a new file, called incidents-june-2023-format.json.

kaelgabriel commented 1 year ago

Thanks for the dilligent work in maintaining your work and giving us cool ideas for personal projects.

I will try to use your method of always referencing an Issue in a git commit, it seems what I need to understand what I did like 3 months ago.