t-rex-tileserver / t-rex

t-rex is a vector tile server specialized on publishing MVT tiles from your own data
https://t-rex.tileserver.ch/
MIT License
556 stars 69 forks source link

Awesome Tool - Anyway to Improve Cache Generation Time? #121

Closed reyemtm closed 5 years ago

reyemtm commented 5 years ago

Awesome tool, got it running in no time on Ubuntu 18. One issue is the cache generation speed. Overall time is not an issue at under 2 minutes for a 3MB geojson, but this seems slow compared to my current method using geojson-vt in node. The file is in WGS84. I do get a log warning of unknown field type when it is serving. I will try with another file that does not log any errors and report results. The reprojecting to 3857 may also be a factor...

pka commented 5 years ago

For PostGIS data, parallel seeding mode is quite effective. With 4 cores you can run something like

t_rex generate --config mvtbench.toml --progress=false --nodes=4 --nodeno=0 &
t_rex generate --config mvtbench.toml --progress=false --nodes=4 --nodeno=1 &
t_rex generate --config mvtbench.toml --progress=false --nodes=4 --nodeno=2 &
t_rex generate --config mvtbench.toml --progress=true  --nodes=4 --nodeno=3

Parallization of a single file is probably less effective

reyemtm commented 5 years ago

Ok, good to know. Will test this method and report back.

On Wed, Mar 20, 2019, 4:16 PM Pirmin Kalberer notifications@github.com wrote:

For PostGIS data, parallel seeding mode is quite effective. With 4 cores you can run something like

t_rex generate --config mvtbench.toml --progress=false --nodes=4 --nodeno=0 & t_rex generate --config mvtbench.toml --progress=false --nodes=4 --nodeno=1 & t_rex generate --config mvtbench.toml --progress=false --nodes=4 --nodeno=2 & t_rex generate --config mvtbench.toml --progress=true --nodes=4 --nodeno=3

Parallization of a single file is probably less effective

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/t-rex-tileserver/t-rex/issues/121#issuecomment-475010739, or mute the thread https://github.com/notifications/unsubscribe-auth/AGGj0b3p0Cz_ORNBk5W0Y6FtDvwD8bHvks5vYpc0gaJpZM4b_sgU .