search

omniscale / imposm3

Imposm imports OpenStreetMap data into PostGIS
http://imposm.org/docs/imposm3/latest/
Apache License 2.0
710 stars 156 forks source link

Bad connection when finish updating data #205

Open HansonYip opened 5 years ago

HansonYip commented 5 years ago

Environment

Description

It took about 54h to apply a half-month's diff file (~1.2G) into the PostGIS. But a bad connection error occured when it finished processing. A part of the log is shown as below:

[2019-07-07T16:09:01Z] 53:30:01 [progress] 45h24m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:10:01Z] 53:31:01 [progress] 45h25m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:10:10Z] 53:31:10 [step] Finished: Updating generalized tables in 1h0m20.502597387s
[2019-07-07T16:11:01Z] 53:32:01 [progress] 45h26m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:12:01Z] 53:33:01 [progress] 45h27m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:13:01Z] 53:34:01 [progress] 45h28m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:14:01Z] 53:35:01 [progress] 45h29m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:15:01Z] 53:36:01 [progress] 45h30m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:16:01Z] 53:37:01 [progress] 45h31m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:17:01Z] 53:38:01 [progress] 45h32m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:18:01Z] 53:39:01 [progress] 45h33m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:19:01Z] 53:40:01 [progress] 45h34m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:20:01Z] 53:41:01 [progress] 45h35m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:21:01Z] 53:42:01 [progress] 45h36m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:22:01Z] 53:43:01 [progress] 45h37m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:23:01Z] 53:44:01 [progress] 45h38m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:24:01Z] 53:45:01 [progress] 45h39m0s C:       0/s (0) N:    1300/s (1116384) W:       0/s (6058593) R:      0/s (191937)
[2019-07-07T16:24:53Z] 53:45:53 [step] Finished: Processing /data/update_tiles_data/.osm_update.sh.20190705-101547/changes.osc.gz in 53h45m43.295688602s
[2019-07-07T16:24:53Z] 53:45:54 [fatal] Unable to process /data/update_tiles_data/.osm_update.sh.20190705-101547/changes.osc.gz: driver: bad connection

As the result of the exception, it can not continue to generate the file about expired tiles. I think this is a bug because I retried the process and the exception happened again.