search

developmentseed / planet-stream

Stream the planet!
BSD 3-Clause "New" or "Revised" License
31 stars 9 forks source link

Use as a generic OSM event stream #22

Open iandees opened 7 years ago

iandees commented 7 years ago

Hi there! I've built several tools that do stream processing on top of the replications diffs coming from OSM. I have a supybot plugin that spams #osm-bot on OFTC with new users mapping, a Slack bot that spams #new-mappers on the OSM US Slack channel, and some other stuff that I use locally to keep track of things. Each of these tools uses different, one-off style code and I'd love to find something to centralize on. Planet-stream seems like a great possibility...

Would it be possible to run planet-stream without any Overpass server? It's hard to tell, but will planet-stream give me events for all OSM changes (changesets, nodes, ways, relations) or just changesets? Is there a built-in way to limit the events received to only one type of OSM "thing"? How would you envision adding support for OSM notes?

kamicut commented 7 years ago

Hey @iandees unfortunately I just saw your comment 😞 sorry for taking so long to answer.

I'm working with a few people from osmlab to figure out how to remove Overpass as a dependency. What Overpass gives us is resolved geometries that we then match with changeset comments (on the changeset id) to calculate stats for missingmaps.org

planet-stream does have a parser for OSM replication files, but I don't know what the ideal interface would be for "event". Right now the event is "as soon as you find a match between the changeset ids and overpass", but this can definitely change.

I'll pull in @mojodna here because he's also taking a look at this repo for upgrades to Missing Maps metrics.