search

openoakland / oakland-transit-data

work in progress to analyze AC transit and other oakland transit data
1 stars 0 forks source link

Find raw data sources #1

Open erin-hancock opened 10 years ago

erin-hancock commented 10 years ago
erin-hancock commented 10 years ago

Link to one route CSV: http://www.actransit.org/maps/csv_schedule.php?line_id=4621&schedule_id=11826 (route 51B) Link to route page: http://www.actransit.org/maps/schedule_results.php?ms_view_type=1&version_id=22&maps_category=2&maps_line=1&map_submit=Get+Schedule (route 1)

erin-hancock commented 10 years ago 
<option value="1">LINE 1
</option><option value="1R">LINE 1R</option>
<option value="7">LINE 7</option>
<option value="11">LINE 11</option>
<option value="12">LINE 12</option>
<option value="14">LINE 14</option>
<option value="18">LINE 18</option>
<option value="20">LINE 20</option>
<option value="21">LINE 21</option><option value="22">LINE 22</option><option value="25">LINE 25</option><option value="26">LINE 26</option><option value="31">LINE 31</option><option value="32">LINE 32</option><option value="37">LINE 37</option><option value="39">LINE 39</option><option value="40">LINE 40</option><option value="45">LINE 45</option><option value="46">LINE 46</option><option value="47">LINE 47</option><option value="48">LINE 48</option><option value="49">LINE 49</option><option value="51A">LINE 51A</option><option value="51B">LINE 51B</option><option value="52">LINE 52</option><option value="54">LINE 54</option><option value="57">LINE 57</option><option value="58L">LINE 58L</option><option value="60">LINE 60</option><option value="62">LINE 62</option><option value="65">LINE 65</option><option value="67">LINE 67</option><option value="70">LINE 70</option><option value="71">LINE 71</option><option value="72">LINE 72</option><option value="72M">LINE 72M</option><option value="72R">LINE 72R</option><option value="73">LINE 73</option><option value="74">LINE 74</option><option value="75">LINE 75</option><option value="76">LINE 76</option><option value="83">LINE 83</option><option value="85">LINE 85</option><option value="86">LINE 86</option><option value="88">LINE 88</option><option value="89">LINE 89</option><option value="93">LINE 93</option><option value="94">LINE 94</option><option value="95">LINE 95</option><option value="97">LINE 97</option><option value="98">LINE 98</option><option value="99">LINE 99</option><option value="200">LINE 200</option><option value="210">LINE 210</option><option value="212">LINE 212</option><option value="215">LINE 215</option><option value="216">LINE 216</option><option value="217">LINE 217</option><option value="232">LINE 232</option><option value="239">LINE 239</option><option value="251">LINE 251</option><option value="275">LINE 275</option><option value="314">LINE 314</option><option value="339">LINE 339</option><option value="356">LINE 356</option><option value="376">LINE 376</option><option value="386">LINE 386
</option>
stopfstedt commented 10 years ago

Re: Nextbus API. apparently, no API key is required.

XML API docs are available as PDF, apparently there is also a dedicated website for it.

stopfstedt commented 10 years ago

get the routes list

curl  -q -H "Accept:application/xml"    "http://webservices.nextbus.com/service/publicXMLFeed?command=routeList&a=actransit"

spits out

<?xml version="1.0" encoding="utf-8" ?> 
<body copyright="All data copyright AC Transit 2014.">
<route tag="B" title="B"/>
<route tag="BSD" title="Broadway Shuttle Weekdays"/>
<route tag="BSN" title="Broadway Shuttle Fri/Sat Nights"/>
<route tag="C" title="C"/>
<route tag="CB" title="CB"/>
<route tag="E" title="E"/>
<route tag="F" title="F"/>
<route tag="FS" title="FS"/>
<route tag="G" title="G"/>
<route tag="H" title="H"/>
<route tag="J" title="J"/>
<route tag="L" title="L"/>
<route tag="LA" title="LA"/>
<route tag="LC" title="LC"/>
<route tag="M" title="M"/>
<route tag="NL" title="NL"/>
<route tag="NX" title="NX"/>
<route tag="NXC" title="NXC"/>
<route tag="NX1" title="NX1"/>
<route tag="NX2" title="NX2"/>
<route tag="NX3" title="NX3"/>
<route tag="NX4" title="NX4"/>
<route tag="O" title="O"/>
<route tag="OX" title="OX"/>
<route tag="P" title="P"/>
<route tag="S" title="S"/>
<route tag="SB" title="SB"/>
<route tag="U" title="U"/>
<route tag="V" title="V"/>
<route tag="W" title="W"/>
<route tag="Z" title="Z"/>
<route tag="1" title="1"/>
<route tag="1R" title="1R"/>
<route tag="7" title="7"/>
<route tag="11" title="11"/>
<route tag="12" title="12"/>
<route tag="14" title="14"/>
<route tag="18" title="18"/>
<route tag="20" title="20"/>
<route tag="21" title="21"/>
<route tag="22" title="22"/>
<route tag="25" title="25"/>
<route tag="26" title="26"/>
<route tag="31" title="31"/>
<route tag="32" title="32"/>
<route tag="37" title="37"/>
<route tag="39" title="39"/>
<route tag="40" title="40"/>
<route tag="45" title="45"/>
<route tag="46" title="46"/>
<route tag="47" title="47"/>
<route tag="48" title="48"/>
<route tag="49" title="49"/>
<route tag="51A" title="51A"/>
<route tag="51B" title="51B"/>
<route tag="52" title="52"/>
<route tag="54" title="54"/>
<route tag="57" title="57"/>
<route tag="58L" title="58L"/>
<route tag="60" title="60"/>
<route tag="62" title="62"/>
<route tag="65" title="65"/>
<route tag="67" title="67"/>
<route tag="70" title="70"/>
<route tag="71" title="71"/>
<route tag="72" title="72"/>
<route tag="72M" title="72M"/>
<route tag="72R" title="72R"/>
<route tag="73" title="73"/>
<route tag="74" title="74"/>
<route tag="75" title="75"/>
<route tag="76" title="76"/>
<route tag="83" title="83"/>
<route tag="85" title="85"/>
<route tag="86" title="86"/>
<route tag="88" title="88"/>
<route tag="89" title="89"/>
<route tag="93" title="93"/>
<route tag="94" title="94"/>
<route tag="95" title="95"/>
<route tag="97" title="97"/>
<route tag="98" title="98"/>
<route tag="99" title="99"/>
<route tag="200" title="200 Union City Bart-Newpark Mall-Fremont Bar" shortTitle="200"/>
<route tag="210" title="210"/>
<route tag="212" title="212"/>
<route tag="215" title="215"/>
<route tag="216" title="216"/>
<route tag="217" title="217"/>
<route tag="232" title="232"/>
<route tag="239" title="239"/>
<route tag="251" title="251"/>
<route tag="275" title="275"/>
<route tag="314" title="314"/>
<route tag="339" title="339"/>
<route tag="356" title="356"/>
<route tag="376" title="376"/>
<route tag="386" title="386"/>
<route tag="687" title="687 Bay Farm Is. / Lincoln Middle Sch." shortTitle="687"/>
</body>
daguar commented 10 years ago

Do y'all want the geodata? You can pull down Google Transit Feed Spec data and they have routes and stuff. Come bother me or LMK here if you want me to dig for it.

On Tue, Mar 4, 2014 at 8:14 PM, Stefan Topfstedt notifications@github.comwrote:

get the routes list

curl -q -H "Accept:application/xml" "http://webservices.nextbus.com/service/publicXMLFeed?command=routeList&a=actransit"

spits out

<?xml version="1.0" encoding="utf-8" ?>

Reply to this email directly or view it on GitHubhttps://github.com/openoakland/oakland-transit-data/issues/1#issuecomment-36708626 .

Dave Guarino 2013 Fellow, Code for America http://www.codeforamerica.org/ dave@codeforamerica.org LinkedIn http://www.linkedin.com/in/daveguarino/ | GitHubhttps://github.com/daguar/

stopfstedt commented 10 years ago

geospatial info about the routes is accessible thru NextBus API as well. http://api-portal.anypoint.mulesoft.com/nextbus/api/nextbus-api/docs/reference#RouteConfig

interested to see how this compares to google's output.

stopfstedt commented 10 years ago

schedule/routes grabber work in progress: https://github.com/stopfstedt/nb-grabber

stopfstedt commented 10 years ago

Alright, got the current AC transit routes and schedules out of NextBus.

Dowload this zip file. Once unzipped, the CSV files are in _csvschedule/actransit, broken down by Busline. There may be multiple files per line, depending on weekday/weekend schedule, direction etc.

FWIW, the XML formatted schedules and routes are included in the zip file as well, please see the xml/actransit directory after extracting.

jbaldo commented 10 years ago

511 Data AC Transit / BART / Muni

max-mapper commented 10 years ago

made a nextbus proxy, put it on heroku:

http://nextbus-proxy.herokuapp.com/agencies/actransit/routes/NL/stops/1001240/predictions

it's an instance of https://github.com/morganney/restbus

API endpoints are listed here: https://github.com/morganney/restbus/blob/master/index.js#L61

stopfstedt commented 10 years ago

RE: real-time vehicle locations, see http://api-portal.anypoint.mulesoft.com/nextbus/api/nextbus-api/docs/reference#VehicleLocations

curl -H "Accept: application/xml" "http://webservices.nextbus.com/service/publicXMLFeed?command=vehicleLocations&a=actransit"
# give it a timestamp
curl -H "Accept: application/xml" "http://webservices.nextbus.com/service/publicXMLFeed?command=vehicleLocations&a=actransit&t=1395196624365"
stopfstedt commented 10 years ago

some info on data limits

Limits on Amount of Data 
In order to prevent some users from being able to download so much data that it would interfere 
with other users we have imposed restrictions on data usage. These limitations could change at 
any time. They currently are: 
 Maximum characters per requester for all commands (IP address): 2MB/20sec 
 Maximum routes per "routeConfig" command: 100 
 Maximum stops per route for the "predictionsForMultiStops" command: 150 
 Maximum number of predictions per stop for prediction commands: 5 
 Maximum timespan for "vehicleLocations" command: 5min

to put this into context, the API lists 98 routes for AC Transit right now.

max-mapper commented 10 years ago

work in progress: https://github.com/maxogden/nextbus-live-feed

converts the XML vehicleLocations API from nextbus (busses that have moved in last x minutes) to a stream-like thing

jbaldo commented 10 years ago
stopfstedt commented 10 years ago

howto writeup so far: https://gist.github.com/stopfstedt/10222988

max-mapper commented 10 years ago

@stopfstedt

heres the CSS output i'm looking for for styling the tilemill map:

#bus {
  [routeTag="NL"] { marker-fill: #e3e33b; }
}
stopfstedt commented 10 years ago

@maxogden here you go: https://gist.github.com/stopfstedt/10300697

max-mapper commented 10 years ago

@stopfstedt nice! here are a couple of renders w/ that stylesheet

the white dots are the default style, so they didn't get overridden by the specific route matches. i'm not sure why there are so many

screen shot 2014-04-09 at 4 03 29 pm

screen shot 2014-04-09 at 4 02 28 pm

screen shot 2014-04-09 at 4 01 16 pm

stopfstedt commented 10 years ago

@maxogden, looks good! not sure what's up with the white dots, went back and verified that we get colors for all lines from the XML dump. tilemill getting overwhelmed perhaps?