planet-stream currently outputs very large changesets. We can split the files and limit the features per changeset to small numbers. This would increase the number of records, and duplicate changeset id fields. However this could be simpler for downstream record processors.
matthewhanson
commented
8 years ago
planet-streamcurrently outputs very large changesets. We can split the files and limit the features per changeset to small numbers. This would increase the number of records, and duplicate changeset id fields. However this could be simpler for downstream record processors.We can make this a flag --limit=100
@nbumbarger @matthewhanson @smit1678