tolidano
commented
4 months ago I believe this is the source of the issue.
Closed tolidano closed 4 months ago
tolidano
commented
4 months ago I believe this is the source of the issue.
tolidano
commented
4 months ago I think you want to do this:
diff --git a/website/index.html b/website/index.html
index 4c379bc..3e131e4 100644
--- a/website/index.html
+++ b/website/index.html
@@ -5,7 +5,7 @@
<link rel="stylesheet" href="https://unpkg.com/leaflet@1.7.1/dist/leaflet.css"/>
<script src="https://unpkg.com/leaflet@1.7.1/dist/leaflet.js"></script>
<script src="https://unpkg.com/leaflet-hash@0.2.1/leaflet-hash.js"></script>
- <script src="https://unpkg.com/protomaps@latest/dist/protomaps.min.js"></script>
+ <script src="https://unpkg.com/protomaps-leaflet@latest/dist/protomaps-leaflet.min.js"></script>
<script src="urlConfig.js"></script>
<script src="tilePath.js"></script>
<style>
@@ -21,9 +21,9 @@
const map = L.map('map')
let hash = new L.Hash(map)
if (!window.location.hash) map.setView(new L.LatLng(53.558572,9.9278215),12)
- var layer = protomaps.leafletLayer({url:'https://' + tilesDistributionHostname + '/' + tilePath + '/{z}/{x}/{y}.mvt'})
+ var layer = protomapsL.leafletLayer({url:'https://' + tilesDistributionHostname + '/' + tilePath + '/{z}/{x}/{y}.mvt'})
layer.addTo(map)
layer.addInspector(map)
</script>
</body>
-</html>
\ No newline at end of file
+</html>I also had to remove the addInspector line, but even after all that, nothing renders, and now no errors.
This is what happened when I pulled us-northeast:
> scripts/build_pmtiles.sh us-northeast
0:00:00 DEB - argument: config=null (path to config file)
0:00:00 DEB - argument: area=us-northeast (geofabrik area to download)
0:00:00 INF - argument: stats=use in-memory stats
0:00:00 DEB - argument: madvise=true (default value for whether to use linux madvise(random) to improve memory-mapped read performance for temporary storage)
0:00:00 DEB - argument: storage=mmap (default storage type for temporary data, one of [ram, mmap, direct])
0:00:00 DEB - argument: threads=12 (num threads)
0:00:00 DEB - argument: write_threads=1 (number of threads to use when writing temp features)
0:00:00 DEB - argument: process_threads=11 (number of threads to use when processing input features)
0:00:00 DEB - argument: bounds=null (bounds)
0:00:00 DEB - argument: polygon=null (a .poly file that limits output to tiles intersecting the shape)
0:00:00 DEB - argument: minzoom=0 (minimum zoom level)
0:00:00 DEB - argument: maxzoom=15 (maximum zoom level up to 15)
0:00:00 DEB - argument: render_maxzoom=15 (maximum rendering zoom level up to 15)
0:00:00 DEB - argument: tmpdir=data/tmp (temp directory)
0:00:00 DEB - argument: feature_read_threads=1 (number of threads to use when reading features at tile write time)
0:00:00 DEB - argument: tile_write_threads=1 (number of threads used to write tiles - only supported by [files, csv, tsv, proto, pbf, json])
0:00:00 DEB - argument: loginterval=10 seconds (time between logs)
0:00:00 DEB - argument: force=true (overwriting output file and ignore disk/RAM warnings)
0:00:00 DEB - argument: append=false (append to the output file - only supported by [files, csv, tsv, proto, pbf, json])
0:00:00 DEB - argument: compress_temp=false (compress temporary feature storage (uses more CPU, but less disk space))
0:00:00 DEB - argument: mmap_temp=true (use memory-mapped IO for temp feature files)
0:00:00 DEB - argument: sort_max_readers=6 (maximum number of concurrent read threads to use when sorting chunks)
0:00:00 DEB - argument: sort_max_writers=6 (maximum number of concurrent write threads to use when sorting chunks)
0:00:00 DEB - argument: nodemap_type=sparsearray (type of node location map, one of [noop, sortedtable, sparsearray, array])
0:00:00 DEB - argument: nodemap_storage=mmap (storage for node location map, one of [ram, mmap, direct])
0:00:00 DEB - argument: nodemap_madvise=true (use linux madvise(random) for node locations)
0:00:00 DEB - argument: multipolygon_geometry_storage=mmap (storage for multipolygon geometries, one of [ram, mmap, direct])
0:00:00 DEB - argument: multipolygon_geometry_madvise=true (use linux madvise(random) for temporary multipolygon geometry storage)
0:00:00 DEB - argument: http_user_agent=Planetiler downloader (https://github.com/onthegomap/planetiler) (User-Agent header to set when downloading files over HTTP)
0:00:00 DEB - argument: http_timeout=30 seconds (Timeout to use when downloading files over HTTP)
0:00:00 DEB - argument: http_retries=1 (Retries to use when downloading files over HTTP)
0:00:00 DEB - argument: http_retry_wait=5 seconds (How long to wait before retrying HTTP request)
0:00:00 DEB - argument: download_chunk_size_mb=100 (Size of file chunks to download in parallel in megabytes)
0:00:00 DEB - argument: download_threads=1 (Number of parallel threads to use when downloading each file)
0:00:00 DEB - argument: download_max_bandwidth= (Maximum bandwidth to consume when downloading files in units mb/s, mbps, kbps, etc.)
0:00:00 DEB - argument: min_feature_size_at_max_zoom=0.0625 (Default value for the minimum size in tile pixels of features to emit at the maximum zoom level to allow for overzooming)
0:00:00 DEB - argument: min_feature_size=1.0 (Default value for the minimum size in tile pixels of features to emit below the maximum zoom level)
0:00:00 DEB - argument: simplify_tolerance_at_max_zoom=0.0625 (Default value for the tile pixel tolerance to use when simplifying features at the maximum zoom level to allow for overzooming)
0:00:00 DEB - argument: simplify_tolerance=0.1 (Default value for the tile pixel tolerance to use when simplifying features below the maximum zoom level)
0:00:00 DEB - argument: osm_lazy_reads=true (Read OSM blocks from disk in worker threads)
0:00:00 DEB - argument: skip_filled_tiles=false (Skip writing tiles containing only polygon fills to the output)
0:00:00 DEB - argument: tile_warning_size_mb=1.0 (Maximum size in megabytes of a tile to emit a warning about)
0:00:00 DEB - argument: color=null (Color the terminal output)
0:00:00 DEB - argument: keep_unzipped=false (keep unzipped sources by default after reading)
0:00:00 DEB - argument: tile_compression=gzip (the tile compression, one of [gzip, none])
0:00:00 DEB - argument: output_layerstats=false (output a tsv.gz file for each tile/layer size)
0:00:00 DEB - argument: debug_url=https://onthegomap.github.io/planetiler-demo/#{z}/{lat}/{lon} (debug url to use for displaying tiles with {z} {lat} {lon} placeholders)
0:00:00 DEB - argument: tile_weights=data/tile_weights.tsv.gz (tsv.gz file with columns z,x,y,loads to generate weighted average tile size stat)
0:00:00 DEB - argument: max_point_buffer=Infinity (Max tile pixels to include points outside tile bounds. Set to a lower value to reduce tile size for clients that handle label collisions across tiles (most web and native clients). NOTE: Do not reduce if you need to support raster tile rendering)
0:00:00 DEB - argument: log_jts_exceptions=false (Emit verbose details to debug JTS geometry errors)
0:00:00 DEB - argument: only_download=false (download source data then exit)
0:00:00 DEB - argument: download=true (download sources)
0:00:00 DEB - argument: refresh_sources=false (download new version of source files if they have changed)
0:00:00 DEB - argument: download_osm_tile_weights=true (download OSM tile weights file)
0:00:00 DEB - argument: temp_nodes=data/tmp/node.db (temp node db location)
0:00:00 DEB - argument: temp_multipolygons=data/tmp/multipolygon.db (temp multipolygon db location)
0:00:00 DEB - argument: temp_features=data/tmp/feature.db (temp feature db location)
0:00:00 DEB - argument: osm_parse_node_bounds=false (parse bounds from OSM nodes instead of header)
0:00:00 DEB - argument: ne_path=data/sources/natural_earth_vector.sqlite.zip (ne sqlite db path)
0:00:00 DEB - argument: refresh_ne=false (Download new version of ne if changed)
0:00:00 DEB - argument: free_ne_after_read=false (delete ne input file after reading to make space for output (reduces peak disk usage))
0:00:00 DEB - argument: ne_url=https://naciscdn.org/naturalearth/packages/natural_earth_vector.sqlite.zip (ne sqlite db url)
0:00:00 DEB - argument: ne_keep_unzipped=false (keep unzipped ne after reading)
0:00:00 DEB - argument: osm_path=data/sources/us-northeast.osm.pbf (osm OSM input file path)
0:00:00 DEB - argument: refresh_osm=false (Download new version of osm if changed)
0:00:00 DEB - argument: free_osm_after_read=false (delete osm input file after reading to make space for output (reduces peak disk usage))
0:00:00 DEB - argument: osm_url=geofabrik:us-northeast (osm OSM input file url)
0:00:00 DEB - argument: osm_water_path=data/sources/water-polygons-split-3857.zip (osm_water shapefile path)
0:00:00 DEB - argument: refresh_osm_water=false (Download new version of osm_water if changed)
0:00:00 DEB - argument: free_osm_water_after_read=false (delete osm_water input file after reading to make space for output (reduces peak disk usage))
0:00:00 DEB - argument: osm_water_url=https://osmdata.openstreetmap.de/download/water-polygons-split-3857.zip (osm_water shapefile url)
0:00:00 DEB - argument: osm_land_path=data/sources/land-polygons-split-3857.zip (osm_land shapefile path)
0:00:00 DEB - argument: refresh_osm_land=false (Download new version of osm_land if changed)
0:00:00 DEB - argument: free_osm_land_after_read=false (delete osm_land input file after reading to make space for output (reduces peak disk usage))
0:00:00 DEB - argument: osm_land_url=https://osmdata.openstreetmap.de/download/land-polygons-split-3857.zip (osm_land shapefile url)
0:00:00 DEB - argument: landcover_path=data/sources/daylight-landcover.gpkg (landcover geopackage path)
0:00:00 DEB - argument: refresh_landcover=false (Download new version of landcover if changed)
0:00:00 DEB - argument: free_landcover_after_read=false (delete landcover input file after reading to make space for output (reduces peak disk usage))
0:00:00 DEB - argument: landcover_url=https://r2-public.protomaps.com/datasets/daylight-landcover.gpkg (landcover geopackage url)
0:00:00 DEB - argument: landcover_keep_unzipped=false (keep unzipped landcover after reading)
0:00:01 INF [download:ne] - Downloading https://naciscdn.org/naturalearth/packages/natural_earth_vector.sqlite.zip to data/sources/natural_earth_vector.sqlite.zip
0:00:08 INF [download:ne] - Finished downloading https://naciscdn.org/naturalearth/packages/natural_earth_vector.sqlite.zip to data/sources/natural_earth_vector.sqlite.zip
0:00:08 INF - ne: [ 434M 100% 55M/s ] cpus: 0.4 gc: 0% heap: 70M/17G direct: 163k postGC: 43M
0:00:09 INF - unzipping /Users/shawn/dev/serverlessmaps/data/sources/natural_earth_vector.sqlite.zip to data/sources/natural_earth_vector.sqlite.zip-unzipped/%2Fpackages%2Fnatural_earth_vector.sqlite
0:00:12 DEB - argument: output=us-northeast.pmtiles (output tile archive URI)
0:00:12 DEB - argument: version=false (show version then exit)
0:00:12 INF - Planetiler build git hash: 6ca82766a5f843d8867ccbd324a9900f7769a947
0:00:12 INF - Planetiler build version: 0.7-SNAPSHOT
0:00:12 INF - Planetiler build timestamp: 2024-06-02T21:19:15.207Z
0:00:12 DEB - argument: help=false (show arguments then exit)
0:00:12 DEB - argument: layer_stats=/Users/shawn/dev/serverlessmaps/us-northeast.pmtiles.layerstats.tsv.gz (layer stats output path)
0:00:12 INF - Building Basemap profile into file:///Users/shawn/dev/serverlessmaps/us-northeast.pmtiles in these phases:
0:00:12 INF - download: Download sources [ne, osm, osm_water, osm_land, landcover]
0:00:12 INF - ne: Process features in data/sources/natural_earth_vector.sqlite.zip
0:00:12 INF - osm_pass1: Pre-process OpenStreetMap input (store node locations then relation members)
0:00:12 INF - osm_pass2: Process OpenStreetMap nodes, ways, then relations
0:00:12 INF - osm_water: Process features in data/sources/water-polygons-split-3857.zip
0:00:12 INF - osm_land: Process features in data/sources/land-polygons-split-3857.zip
0:00:12 INF - landcover: Process features in data/sources/daylight-landcover.gpkg
0:00:12 INF - sort: Sort rendered features by tile ID
0:00:12 INF - archive: Encode each tile and write to TileArchiveConfig[format=PMTILES, scheme=FILE, uri=file:///Users/shawn/dev/serverlessmaps/us-northeast.pmtiles, options={}]
0:00:12 INF [download] -
0:00:12 INF [download] - Starting...
0:00:13 INF [download:ne] - Skipping ne: data/sources/natural_earth_vector.sqlite.zip already up-to-date
0:00:13 INF [download:landcover] - Downloading https://r2-public.protomaps.com/datasets/daylight-landcover.gpkg to data/sources/daylight-landcover.gpkg
0:00:13 INF [download:osm] - Downloading https://download.geofabrik.de/north-america/us-northeast-latest.osm.pbf to data/sources/us-northeast.osm.pbf
0:00:14 INF [download:osm_water] - Downloading https://osmdata.openstreetmap.de/download/water-polygons-split-3857.zip to data/sources/water-polygons-split-3857.zip
0:00:14 INF [download:osm_land] - Downloading https://osmdata.openstreetmap.de/download/land-polygons-split-3857.zip to data/sources/land-polygons-split-3857.zip
0:00:14 INF [download:landcover] - Finished downloading https://r2-public.protomaps.com/datasets/daylight-landcover.gpkg to data/sources/daylight-landcover.gpkg
0:00:24 INF [download] - ne: [ 0 0% 0/s ] osm: [ 47M 3% 4.7M/s ] osm_water: [ 19M 2% 1.9M/s ] osm_land: [ 210M 24% 21M/s ] landcover: [ 36M 100% 3.6M/s ] cpus: 0.3 gc: 0% heap: 35M/17G direct: 228k postGC: 66M
0:00:34 INF [download] - ne: [ 0 0% 0/s ] osm: [ 90M 6% 4.2M/s ] osm_water: [ 100M 12% 8M/s ] osm_land: [ 435M 50% 22M/s ] landcover: [ 36M 100% 0/s ] cpus: 0.4 gc: 0% heap: 43M/17G direct: 228k postGC: 66M
0:00:44 INF [download] - ne: [ 0 0% 0/s ] osm: [ 145M 9% 5.5M/s ] osm_water: [ 307M 36% 20M/s ] osm_land: [ 605M 69% 16M/s ] landcover: [ 36M 100% 0/s ] cpus: 0.5 gc: 0% heap: 69M/17G direct: 228k postGC: 67M
0:00:54 INF [download] - ne: [ 0 0% 0/s ] osm: [ 197M 12% 5.1M/s ] osm_water: [ 481M 56% 17M/s ] osm_land: [ 744M 85% 13M/s ] landcover: [ 36M 100% 0/s ] cpus: 0.4 gc: 0% heap: 80M/17G direct: 228k postGC: 66M
0:01:02 INF [download:osm_land] - Finished downloading https://osmdata.openstreetmap.de/download/land-polygons-split-3857.zip to data/sources/land-polygons-split-3857.zip
0:01:04 INF [download] - ne: [ 0 0% 0/s ] osm: [ 243M 15% 4.5M/s ] osm_water: [ 605M 70% 12M/s ] osm_land: [ 880M 100% 13M/s ] landcover: [ 36M 100% 0/s ] cpus: 0.3 gc: 0% heap: 81M/17G direct: 228k postGC: 66M
0:01:14 INF [download] - ne: [ 0 0% 0/s ] osm: [ 290M 18% 4.6M/s ] osm_water: [ 813M 95% 20M/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.3 gc: 0% heap: 70M/17G direct: 228k postGC: 66M
0:01:15 INF [download:osm_water] - Finished downloading https://osmdata.openstreetmap.de/download/water-polygons-split-3857.zip to data/sources/water-polygons-split-3857.zip
0:01:24 INF [download] - ne: [ 0 0% 0/s ] osm: [ 335M 21% 4.5M/s ] osm_water: [ 860M 100% 4.7M/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 29M/17G direct: 228k postGC: 67M
0:01:34 INF [download] - ne: [ 0 0% 0/s ] osm: [ 380M 24% 4.4M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 46M/17G direct: 228k postGC: 67M
0:01:44 INF [download] - ne: [ 0 0% 0/s ] osm: [ 421M 27% 4.1M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 62M/17G direct: 228k postGC: 67M
0:01:54 INF [download] - ne: [ 0 0% 0/s ] osm: [ 464M 29% 4.2M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 78M/17G direct: 228k postGC: 67M
0:02:04 INF [download] - ne: [ 0 0% 0/s ] osm: [ 506M 32% 4.2M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 27M/17G direct: 228k postGC: 67M
0:02:14 INF [download] - ne: [ 0 0% 0/s ] osm: [ 547M 35% 4M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 43M/17G direct: 228k postGC: 67M
0:02:24 INF [download] - ne: [ 0 0% 0/s ] osm: [ 589M 37% 4.2M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 59M/17G direct: 228k postGC: 67M
0:02:34 INF [download] - ne: [ 0 0% 0/s ] osm: [ 632M 40% 4.3M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 75M/17G direct: 228k postGC: 67M
0:02:44 INF [download] - ne: [ 0 0% 0/s ] osm: [ 673M 43% 4.1M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 23M/17G direct: 228k postGC: 66M
0:02:54 INF [download] - ne: [ 0 0% 0/s ] osm: [ 707M 45% 3.3M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 36M/17G direct: 228k postGC: 66M
0:03:04 INF [download] - ne: [ 0 0% 0/s ] osm: [ 741M 47% 3.4M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 49M/17G direct: 228k postGC: 66M
0:03:14 INF [download] - ne: [ 0 0% 0/s ] osm: [ 786M 50% 4.5M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 66M/17G direct: 228k postGC: 66M
0:03:24 INF [download] - ne: [ 0 0% 0/s ] osm: [ 831M 53% 4.5M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 17M/17G direct: 228k postGC: 66M
0:03:34 INF [download] - ne: [ 0 0% 0/s ] osm: [ 875M 55% 4.3M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 34M/17G direct: 228k postGC: 66M
0:03:44 INF [download] - ne: [ 0 0% 0/s ] osm: [ 918M 58% 4.2M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 50M/17G direct: 228k postGC: 66M
0:03:54 INF [download] - ne: [ 0 0% 0/s ] osm: [ 960M 61% 4.2M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 66M/17G direct: 228k postGC: 66M
0:04:04 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1G 63% 4.1M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 83M/17G direct: 228k postGC: 66M
0:04:14 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1G 66% 4.8M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 34M/17G direct: 228k postGC: 66M
0:04:24 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1G 69% 4.4M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 51M/17G direct: 228k postGC: 66M
0:04:34 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.1G 72% 4.5M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 69M/17G direct: 228k postGC: 66M
0:04:44 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.1G 75% 4.9M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 21M/17G direct: 228k postGC: 67M
0:04:54 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.2G 79% 5.2M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 41M/17G direct: 228k postGC: 67M
0:05:04 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.3G 82% 5.6M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 62M/17G direct: 228k postGC: 67M
0:05:14 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.3G 86% 5.9M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 17M/17G direct: 228k postGC: 67M
0:05:24 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.4G 90% 6.9M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 43M/17G direct: 228k postGC: 67M
0:05:34 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.5G 95% 7.2M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 70M/17G direct: 228k postGC: 67M
0:05:44 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.5G 99% 6.6M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 29M/17G direct: 228k postGC: 67M
0:05:46 INF [download:osm] - Finished downloading https://download.geofabrik.de/north-america/us-northeast-latest.osm.pbf to data/sources/us-northeast.osm.pbf
0:05:46 INF [download] - ne: [ 0 0% 0/s ] osm: [ 1.5G 100% 5.7M/s ] osm_water: [ 860M 100% 0/s ] osm_land: [ 880M 100% 0/s ] landcover: [ 36M 100% 0/s ] cpus: 0.1 gc: 0% heap: 35M/17G direct: 228k postGC: 67M
0:05:46 INF [download] - Finished in 5m35s cpu:50s avg:0.1
0:05:47 INF [download] - Downloading pre-computed tile weights from https://raw.githubusercontent.com/onthegomap/planetiler/main/layerstats/top_osm_tiles.tsv.gz to data/tile_weights.tsv.gz
0:05:47 DEB [download] - ✓ 1.8G storage on /System/Volumes/Data (/dev/disk3s5) requested for read phase disk, 166G available
0:05:47 DEB [download] - - 1.6G used for temporary node location cache
0:05:47 DEB [download] - - 242M used for temporary multipolygon geometry cache
0:05:47 DEB [download] - ✓ 300M JVM heap requested for read phase, 17G available
0:05:47 DEB [download] - - 300M used for sparsearray node location in-memory index
0:05:47 DEB [download] - ✓ 1.8G storage on /System/Volumes/Data (/dev/disk3s5) requested for read phase, 166G available
0:05:47 DEB [download] - - 1.6G used for sparsearray node location cache
0:05:47 DEB [download] - - 242M used for multipolygon way geometries
0:05:47 DEB [download] - ✓ 1.8G temporary files and 51G of free memory for OS to cache them
0:05:47 INF [download] - Setting map bounds from input: Env[-80.522747 : -66.87164, 38.742866 : 47.462219]
0:05:47 DEB [download] - argument: archive_name=Protomaps Basemap ('name' attribute for tileset metadata)
0:05:47 DEB [download] - argument: archive_description=Basemap layers derived from OpenStreetMap and Natural Earth ('description' attribute for tileset metadata)
0:05:47 DEB [download] - argument: archive_attribution=<a href="https://www.openstreetmap.org/copyright" target="_blank">© OpenStreetMap contributors</a> ('attribution' attribute for tileset metadata)
0:05:47 DEB [download] - argument: archive_version=3.5.2 ('version' attribute for tileset metadata)
0:05:47 DEB [download] - argument: archive_type=baselayer ('type' attribute for tileset metadata)
0:05:47 DEB [download] - argument: archive_format=pbf ('format' attribute for tileset metadata)
0:05:47 INF [download] - Using merge sort feature map, chunk size=2000mb max workers=12
0:05:47 INF [ne] -
0:05:47 INF [ne] - Starting...
0:05:47 INF [ne] - unzipping /Users/shawn/dev/serverlessmaps/data/sources/natural_earth_vector.sqlite.zip to data/tmp/%2Fpackages%2Fnatural_earth_vector.sqlite
0:05:50 INF [ne] - unzipping /Users/shawn/dev/serverlessmaps/data/sources/natural_earth_vector.sqlite.zip to data/tmp/%2Fpackages%2Fnatural_earth_vector.sqlite
0:05:59 INF [ne] - read: [ 349k 100% 37k/s ] write: [ 913 96/s ] 552k
cpus: 1.6 gc: 0% heap: 271M/17G direct: 228k postGC: 98M
-> (0/3) -> read( -%) -> (0/1k) -> process( -% -% -% -% -% -% -% -% -% -% -%) -> (0/62k) -> write( -%)
0:05:59 INF [ne] - Finished in 13s cpu:18s avg:1.4
0:05:59 INF [ne] - read 1x(72% 9s done:3s)
0:05:59 INF [ne] - process 11x(2% 0.3s wait:9s done:3s)
0:05:59 INF [ne] - write 1x(0% 0s wait:9s done:3s)
0:05:59 INF [osm_pass1] -
0:05:59 INF [osm_pass1] - Starting...
0:06:06 INF [osm_pass1:process] - Finished nodes: 188,824,734 (29M/s) in 6s cpu:30s avg:4.7
0:06:07 INF [osm_pass1:process] - Finished ways: 20,853,218 (12M/s) in 2s cpu:15s avg:9.1
0:06:08 INF [osm_pass1:process] - Finished relations: 206,411 (938k/s) in 0.2s cpu:1s avg:6.2
0:06:08 INF [osm_pass1] - nodes: [ 188M 22M/s ] 2.8G ways: [ 20M 2.5M/s ] rels: [ 206k 24k/s ] blocks: [ 26k 3.1k/s ]
cpus: 5.7 gc: 3% heap: 1.4G/17G direct: 212k postGC: 649M hppc: 2.8M
read( -%) -> (0/31) -> parse( -% -% -% -% -% -% -% -% -% -%) -> (0/22) -> process( -%)
0:06:08 DEB [osm_pass1] - Processed 26,237 blocks:
0:06:08 DEB [osm_pass1] - nodes: 188,824,734 (29M/s) in 6s cpu:30s avg:4.7
0:06:08 DEB [osm_pass1] - ways: 20,853,218 (12M/s) in 2s cpu:15s avg:9.1
0:06:08 DEB [osm_pass1] - relations: 206,411 (938k/s) in 0.2s cpu:1s avg:6.2
0:06:08 INF [osm_pass1] - Finished in 8s cpu:47s avg:5.7
0:06:08 INF [osm_pass1] - read 1x(4% 0.3s wait:8s)
0:06:08 INF [osm_pass1] - parse 10x(42% 4s wait:4s)
0:06:08 INF [osm_pass1] - process 1x(90% 7s)
0:06:08 INF [osm_pass2] -
0:06:08 INF [osm_pass2] - Starting...
0:06:15 DEB [osm_pass2:process] - Sorting long long multimap...
0:06:15 INF [osm_pass2:process] - Finished nodes: 188,824,734 (24M/s) in 8s cpu:1m20s avg:10.6
0:06:15 DEB [osm_pass2:process] - Sorted long long multimap 0s cpu:0.1s avg:6.6
0:06:18 INF [osm_pass2] - nodes: [ 188M 100% 18M/s ] 2.8G ways: [ 779k 4% 77k/s ] rels: [ 0 0% 0/s ] features: [ 6.3M 630k/s ] 2G blocks: [ 23k 90% 2.3k/s ]
cpus: 10.6 gc: 1% heap: 2.3G/17G direct: 404k postGC: 669M relInfo: 2.7M mpGeoms: 449k
read( 3%) -> (11/22) -> process(87% 91% 89% 88% 90% 87% 89% 90% 90% 89% 89%) -> (7.4k/62k) -> write(15%)
0:06:28 INF [osm_pass2] - nodes: [ 188M 100% 0/s ] 2.8G ways: [ 3.3M 16% 252k/s ] rels: [ 0 0% 0/s ] features: [ 16M 1M/s ] 3.3G blocks: [ 24k 92% 31/s ]
cpus: 10.8 gc: 2% heap: 2G/17G direct: 754k postGC: 660M relInfo: 2.7M mpGeoms: 38M
read( 0%) -> (11/22) -> process(91% 91% 92% 91% 90% 91% 90% 91% 91% 92% 91%) -> (5.6k/62k) -> write(27%)
0:06:38 INF [osm_pass2] - nodes: [ 188M 100% 0/s ] 2.8G ways: [ 6.8M 33% 350k/s ] rels: [ 0 0% 0/s ] features: [ 25M 907k/s ] 3.3G blocks: [ 24k 93% 43/s ]
cpus: 10.8 gc: 2% heap: 3G/17G direct: 754k postGC: 675M relInfo: 2.7M mpGeoms: 52M
read( 0%) -> (11/22) -> process(94% 94% 94% 95% 94% 94% 94% 94% 95% 94% 94%) -> (5k/62k) -> write(21%)
0:06:48 INF [osm_pass2] - nodes: [ 188M 100% 0/s ] 2.8G ways: [ 10M 49% 339k/s ] rels: [ 0 0% 0/s ] features: [ 35M 1M/s ] 4.5G blocks: [ 24k 95% 42/s ]
cpus: 10.3 gc: 2% heap: 3G/17G direct: 738k postGC: 673M relInfo: 2.7M mpGeoms: 69M
read( 0%) -> (11/22) -> process(88% 88% 87% 88% 87% 88% 88% 88% 88% 88% 88%) -> (7.9k/62k) -> write(24%)
0:06:58 INF [osm_pass2] - nodes: [ 188M 100% 0/s ] 2.8G ways: [ 14M 68% 401k/s ] rels: [ 0 0% 0/s ] features: [ 46M 1M/s ] 5.7G blocks: [ 25k 97% 50/s ]
cpus: 10.7 gc: 2% heap: 3.5G/17G direct: 738k postGC: 686M relInfo: 2.7M mpGeoms: 100M
read( 0%) -> (11/22) -> process(93% 93% 92% 93% 93% 92% 93% 93% 93% 93% 93%) -> (3.7k/62k) -> write(25%)
0:07:08 INF [osm_pass2] - nodes: [ 188M 100% 0/s ] 2.8G ways: [ 17M 86% 358k/s ] rels: [ 0 0% 0/s ] features: [ 56M 948k/s ] 5.7G blocks: [ 25k 98% 44/s ]
cpus: 10.7 gc: 2% heap: 2.6G/17G direct: 738k postGC: 682M relInfo: 2.7M mpGeoms: 121M
read( 0%) -> (11/22) -> process(95% 95% 95% 95% 95% 95% 87% 95% 94% 87% 95%) -> (5.2k/62k) -> write(23%)
0:07:16 INF [osm_pass2:process] - Finished ways: 20,853,218 (342k/s) in 1m1s cpu:10m48s gc:1s avg:10.6
0:07:18 INF [osm_pass2] - nodes: [ 188M 100% 0/s ] 2.8G ways: [ 20M 100% 299k/s ] rels: [ 30k 15% 3k/s ] features: [ 63M 784k/s ] 6.9G blocks: [ 26k 100% 38/s ]
cpus: 10.5 gc: 2% heap: 2.6G/17G direct: 705k postGC: 977M relInfo: 2.7M mpGeoms: 150M
read( 0%) -> (11/22) -> process(89% 88% 88% 88% 89% 89% 84% 89% 88% 82% 89%) -> (6.9k/62k) -> write(19%)
0:07:28 INF [osm_pass2] - nodes: [ 188M 100% 0/s ] 2.8G ways: [ 20M 100% 0/s ] rels: [ 171k 83% 14k/s ] features: [ 64M 77k/s ] 6.9G blocks: [ 26k 100% 1/s ]
cpus: 10.4 gc: 3% heap: 1.3G/17G direct: 705k postGC: 707M relInfo: 2.7M mpGeoms: 150M
read( -%) -> (0/22) -> process(87% 88% 87% 88% 87% 88% 87% 87% 87% 87% 88%) -> (5k/62k) -> write( 2%)
0:07:32 INF [osm_pass2:process] - Finished relations: 206,411 (12k/s) in 16s cpu:2m46s avg:10.4
0:07:32 INF [osm_pass2] - nodes: [ 188M 100% 0/s ] 2.8G ways: [ 20M 100% 0/s ] rels: [ 206k 100% 7.7k/s ] features: [ 64M 70k/s ] 5.4G blocks: [ 26k 100% 2/s ]
cpus: 10.2 gc: 1% heap: 1.8G/17G direct: 155k postGC: 706M relInfo: 2.7M mpGeoms: 150M
read( -%) -> (0/22) -> process( -% -% -% -% -% -% -% -% -% -% -%) -> (0/62k) -> write( -%)
0:07:32 DEB [osm_pass2] - Processed 26,237 blocks:
0:07:32 DEB [osm_pass2] - nodes: 188,824,734 (24M/s) in 8s cpu:1m20s avg:10.6
0:07:32 DEB [osm_pass2] - ways: 20,853,218 (342k/s) in 1m1s cpu:10m48s gc:1s avg:10.6
0:07:32 DEB [osm_pass2] - relations: 206,411 (12k/s) in 16s cpu:2m46s avg:10.4
0:07:32 INF [osm_pass2] - Finished in 1m25s cpu:14m56s gc:2s avg:10.6
0:07:32 INF [osm_pass2] - read 1x(1% 0.4s wait:1m11s done:13s)
0:07:32 INF [osm_pass2] - process 11x(90% 1m17s)
0:07:32 INF [osm_pass2] - write 1x(19% 16s wait:1m6s)
0:07:33 INF [osm_water] -
0:07:33 INF [osm_water] - Starting...
0:07:41 INF [osm_water] - read: [ 43 100% 8/s ] write: [ 466k 97k/s ] 5.4G
cpus: 3.6 gc: 1% heap: 1G/17G direct: 58M postGC: 686M
-> (0/3) -> read( -%) -> (0/1k) -> process( -% -% -% -% -% -% -% -% -% -% -%) -> (0/62k) -> write( -%)
0:07:41 INF [osm_water] - Finished in 8s cpu:23s avg:2.7
0:07:41 INF [osm_water] - read 1x(36% 3s done:5s)
0:07:41 INF [osm_water] - process 11x(12% 1s wait:2s done:5s)
0:07:41 INF [osm_water] - write 1x(0% 0s wait:5s done:4s)
0:07:41 INF [osm_land] -
0:07:41 INF [osm_land] - Starting...
0:07:48 INF [osm_land] - read: [ 5.4k 100% 1.2k/s ] write: [ 1.4M 344k/s ] 5.5G
cpus: 3 gc: 0% heap: 1.8G/17G direct: 66M postGC: 729M
-> (0/3) -> read( -%) -> (0/1k) -> process( -% -% -% -% -% -% -% -% -% -% -%) -> (0/62k) -> write( -%)
0:07:48 INF [osm_land] - Finished in 7s cpu:16s avg:2.2
0:07:48 INF [osm_land] - read 1x(44% 3s done:4s)
0:07:48 INF [osm_land] - process 11x(11% 0.8s wait:3s done:4s)
0:07:48 INF [osm_land] - write 1x(1% 0.1s wait:4s done:3s)
0:07:48 INF [landcover] -
0:07:48 INF [landcover] - Starting...
0:07:49 INF [landcover] - read: [ 27k 100% 42k/s ] write: [ 882 1.3k/s ] 5.5G
cpus: 4.2 gc: 0% heap: 997M/17G direct: 66M postGC: 675M
-> (0/3) -> read( -%) -> (0/1k) -> process( -% -% -% -% -% -% -% -% -% -% -%) -> (0/62k) -> write( -%)
0:07:49 INF [landcover] - Finished in 0.7s cpu:3s avg:4.1
0:07:49 INF [landcover] - read 1x(65% 0.5s)
0:07:49 INF [landcover] - process 11x(6% 0s)
0:07:49 INF [landcover] - write 1x(0% 0s)
0:07:49 INF [landcover] - Deleting node.db to make room for output file
0:07:49 INF [sort] -
0:07:49 INF [sort] - Starting...
0:07:49 INF [sort] - Grouped 14 chunks into 5
0:07:57 INF [sort] - chunks: [ 5 / 5 100% ] 5.5G
cpus: 6.5 gc: 8% heap: 5.1G/17G direct: 66M postGC: 4.3G
-> (0/8) -> worker( -% -%)
0:07:57 INF [sort] - Finished in 8s cpu:52s avg:6.5
0:07:57 INF [sort] - worker 2x(41% 3s wait:3s)
0:07:57 INF [sort] - read:3s write:4s sort:6s
0:07:57 INF [archive] -
0:07:57 INF [archive] - Starting...
0:07:59 INF [archive:write] - Starting z0
0:07:59 INF [archive:write] - Finished z0 in 0s cpu:0s avg:9.8, now starting z1
0:07:59 INF [archive:write] - Finished z1 in 0s cpu:0s avg:57.9, now starting z2
0:07:59 INF [archive:write] - Finished z2 in 0.1s cpu:1s avg:11.3, now starting z3
0:07:59 INF [archive:write] - Finished z3 in 0s cpu:0s avg:19.7, now starting z4
0:07:59 INF [archive:write] - Finished z4 in 0s cpu:0s avg:4.9, now starting z5
0:07:59 INF [archive:write] - Finished z5 in 0s cpu:0s avg:2.9, now starting z6
0:08:00 INF [archive:write] - Finished z6 in 1s cpu:11s avg:10.4, now starting z7
0:08:02 INF [archive:write] - Finished z7 in 1s cpu:14s avg:10.9, now starting z8
0:08:05 INF [archive:write] - Finished z8 in 3s cpu:32s avg:10.8, now starting z9
0:08:08 INF [archive] - features: [ 1.9M 3% 193k/s ] 5.5G tiles: [ 495 49/s ] 10M
cpus: 10.8 gc: 5% heap: 2.3G/17G direct: 66M postGC: 2G
read( 9%) -> (813/870) -> encode(81% 81% 81% 82% 80% 81% 82% 81% 81% 81% 81%) -> (859/860) -> write( 0%)
last tile: 9/148/194 (z9 18%) https://onthegomap.github.io/planetiler-demo/#9.5/39.63901/-75.58594
0:08:08 INF [archive:write] - Finished z9 in 4s cpu:38s avg:10.9, now starting z10
0:08:16 INF [archive:write] - Finished z10 in 8s cpu:1m26s avg:10.8, now starting z11
0:08:18 INF [archive] - features: [ 3.1M 5% 122k/s ] 5.5G tiles: [ 4.5k 404/s ] 44M
cpus: 10.8 gc: 2% heap: 6.6G/17G direct: 66M postGC: 1.7G
read( 1%) -> (830/870) -> encode(93% 93% 93% 93% 93% 92% 93% 93% 93% 94% 93%) -> (859/860) -> write( 0%)
last tile: 11/615/761 (z11 13%) https://onthegomap.github.io/planetiler-demo/#11.5/41.83679/-71.80664
0:08:23 INF [archive:write] - Finished z11 in 7s cpu:1m16s avg:10.8, now starting z12
0:08:28 INF [archive] - features: [ 5.7M 9% 259k/s ] 5.5G tiles: [ 17k 1.3k/s ] 109M
cpus: 10.8 gc: 2% heap: 2.4G/17G direct: 66M postGC: 1.6G
read( 2%) -> (788/870) -> encode(93% 94% 93% 93% 93% 93% 93% 93% 93% 93% 93%) -> (859/860) -> write( 0%)
last tile: 12/1233/1520 (z12 13%) https://onthegomap.github.io/planetiler-demo/#12.5/42.00032/-71.58691
0:08:33 INF [archive:write] - Finished z12 in 9s cpu:1m41s avg:10.8, now starting z13
0:08:38 INF [archive] - features: [ 11M 17% 574k/s ] 5.5G tiles: [ 70k 5.2k/s ] 256M
cpus: 10.8 gc: 3% heap: 1.6G/17G direct: 66M postGC: 1.5G
read( 5%) -> (823/870) -> encode(91% 91% 91% 92% 91% 91% 91% 91% 91% 91% 91%) -> (859/860) -> write( 1%)
last tile: 13/2467/3040 (z13 13%) https://onthegomap.github.io/planetiler-demo/#13.5/42.01665/-71.56494
0:08:45 INF [archive:write] - Finished z13 in 12s cpu:2m15s avg:10.9, now starting z14
0:08:48 INF [archive] - features: [ 19M 29% 781k/s ] 5.5G tiles: [ 227k 15k/s ] 433M
cpus: 10.8 gc: 4% heap: 2.3G/17G direct: 66M postGC: 1.8G
read( 8%) -> (846/870) -> encode(89% 89% 89% 89% 90% 89% 89% 89% 89% 89% 89%) -> (859/860) -> write( 3%)
last tile: 14/4778/6143 (z14 13%) https://onthegomap.github.io/planetiler-demo/#14.5/40.98819/-75.00366
0:08:58 INF [archive] - features: [ 27M 42% 858k/s ] 5.5G tiles: [ 284k 5.6k/s ] 621M
cpus: 10.7 gc: 4% heap: 2.8G/17G direct: 66M postGC: 1.5G
read( 8%) -> (843/870) -> encode(89% 89% 87% 90% 89% 85% 87% 90% 90% 90% 88%) -> (859/860) -> write( 3%)
last tile: 14/4953/6039 (z14 13%) https://onthegomap.github.io/planetiler-demo/#14.5/42.69051/-71.15845
0:09:08 INF [archive] - features: [ 33M 50% 568k/s ] 5.5G tiles: [ 418k 13k/s ] 725M
cpus: 10.7 gc: 4% heap: 1.7G/17G direct: 66M postGC: 1.7G
read( 5%) -> (839/870) -> encode(91% 92% 92% 92% 91% 89% 90% 91% 90% 92% 91%) -> (859/860) -> write( 2%)
last tile: 14/4777/6200 (z14 18%) https://onthegomap.github.io/planetiler-demo/#14.5/40.03603/-75.02563
0:09:13 INF [archive:write] - Finished z14 in 28s cpu:5m4s gc:1s avg:10.7, now starting z15
0:09:18 INF [archive] - features: [ 49M 74% 1.5M/s ] 5.5G tiles: [ 1.1M 67k/s ] 1.2G
cpus: 10.8 gc: 5% heap: 5.6G/17G direct: 66M postGC: 4.4G
read(16%) -> (845/870) -> encode(91% 90% 90% 91% 91% 90% 91% 90% 90% 91% 90%) -> (859/860) -> write(14%)
last tile: 15/9837/12276 (z15 13%) https://onthegomap.github.io/planetiler-demo/#15.5/41.07521/-71.922
0:09:23 INF [archive:write] - Finished z15 in 10s cpu:1m50s avg:10.9
0:09:23 INF [archive:write] - Building directories with 4096 entries per leaf, attempt 1...
0:09:24 INF [archive:write] - Built directories with 195 leaves, 812B root directory
0:09:24 INF [archive:write] - Writing metadata and leaf directories...
0:09:24 INF [archive:write] - Writing header...
0:09:24 INF [archive:write] - # addressed tiles: 1811354
0:09:24 INF [archive:write] - # of tile entries: 798396
0:09:24 INF [archive:write] - # of tile contents: 748589
0:09:24 INF [archive:write] - Root directory: 812B
0:09:24 INF [archive:write] - # leaves: 195
0:09:24 INF [archive:write] - Leaf directories: 1.5MB
0:09:24 INF [archive:write] - Avg leaf size: 7.9kB
0:09:24 INF [archive:write] - Total dir bytes: 1.5MB
0:09:24 INF [archive:write] - Average bytes per addressed tile: 0.8587172910430539
0:09:24 INF [archive] - features: [ 66M 100% 3M/s ] 5.5G tiles: [ 1.8M 124k/s ] 1.7G
cpus: 10.6 gc: 5% heap: 5.8G/17G direct: 66M postGC: 1.1G
read( -%) -> (0/870) -> encode( -% -% -% -% -% -% -% -% -% -% -%) -> (0/860) -> write( -%)
last tile: 15/9054/12513 (z15 18%) https://onthegomap.github.io/planetiler-demo/#15.5/39.08317/-80.52429
0:09:24 DEB [archive] - Tile stats:
0:09:24 DEB [archive] - Biggest tiles (gzipped)
1. 9/150/192 (199k) https://onthegomap.github.io/planetiler-demo/#9.5/40.71342/-74.17969 (roads:90k)
2. 15/9647/12320 (180k) https://onthegomap.github.io/planetiler-demo/#15.5/40.70979/-74.0094 (pois:201k)
3. 9/149/193 (173k) https://onthegomap.github.io/planetiler-demo/#9.5/40.17834/-74.88281 (landuse:105k)
4. 9/149/192 (172k) https://onthegomap.github.io/planetiler-demo/#9.5/40.71342/-74.88281 (landuse:118k)
5. 15/9648/12319 (169k) https://onthegomap.github.io/planetiler-demo/#15.5/40.71812/-73.99841 (pois:236k)
6. 9/149/194 (165k) https://onthegomap.github.io/planetiler-demo/#9.5/39.63901/-74.88281 (natural:107k)
7. 9/154/190 (165k) https://onthegomap.github.io/planetiler-demo/#9.5/41.77078/-71.36719 (landuse:102k)
8. 10/308/380 (152k) https://onthegomap.github.io/planetiler-demo/#10.5/41.90214/-71.54297 (landuse:115k)
9. 8/75/96 (147k) https://onthegomap.github.io/planetiler-demo/#8.5/40.44482/-73.82812 (landuse:64k)
10. 9/154/189 (147k) https://onthegomap.github.io/planetiler-demo/#9.5/42.29303/-71.36719 (landuse:72k)
0:09:24 INF [archive] - Other tiles with large layers
15/9542/12414 (256k) https://onthegomap.github.io/planetiler-demo/#15.5/39.92238/-75.16296 (buildings:256k)
0:09:24 DEB [archive] - Max tile sizes
z0 z1 z2 z3 z4 z5 z6 z7 z8 z9 z10 z11 z12 z13 z14 z15 all
boundaries 144 506 646 662 862 950 559 691 1.6k 1.5k 4.6k 2.8k 1.9k 1k 883 716 4.6k
earth 3.5k 5k 3.8k 2.8k 1.7k 5.3k 31k 32k 24k 26k 27k 18k 12k 9.6k 10k 5k 32k
landcover 16k 27k 13k 15k 17k 6.4k 4.9k 3k 0 0 0 0 0 0 0 0 27k
places 797 1.6k 5.9k 7.1k 11k 32k 28k 15k 32k 16k 12k 5.3k 12k 6k 3.6k 2.3k 32k
water 42k 39k 27k 22k 8.5k 5.9k 31k 36k 36k 30k 30k 31k 48k 56k 36k 21k 56k
landuse 0 0 313 1.1k 4.5k 15k 29k 52k 85k 118k 115k 102k 73k 37k 37k 66k 118k
natural 0 0 0 307 1.1k 6.1k 14k 27k 47k 107k 103k 67k 52k 31k 19k 26k 107k
roads 0 0 0 5.6k 8.4k 12k 20k 55k 47k 90k 62k 31k 45k 46k 53k 27k 90k
physical_point 0 0 0 0 1.6k 2.6k 1.5k 1.3k 1k 838 838 929 838 1.4k 1.3k 8.5k 8.5k
pois 0 0 0 0 0 0 0 1.4k 1.5k 1.6k 1.4k 6.1k 11k 20k 17k 236k 236k
physical_line 0 0 0 0 0 0 0 0 0 40k 48k 59k 92k 70k 29k 13k 92k
transit 0 0 0 0 0 0 0 0 0 1.6k 5.7k 41k 25k 30k 21k 13k 41k
buildings 0 0 0 0 0 0 0 0 0 0 0 11k 25k 44k 77k 256k 256k
full tile 63k 74k 52k 55k 56k 86k 130k 197k 218k 277k 215k 187k 193k 161k 149k 384k 384k
gzipped 38k 47k 34k 38k 39k 59k 88k 138k 147k 199k 152k 132k 120k 101k 104k 180k 199k
0:09:24 DEB [archive] - Max tile: 384k (gzipped: 199k)
0:09:24 DEB [archive] - Avg tile: 47k (gzipped: 32k) using weighted average based on OSM traffic
0:09:24 DEB [archive] - # tiles: 1,811,354
0:09:24 DEB [archive] - # features: 66,886,496
0:09:24 INF [archive] - Finished in 1m27s cpu:15m28s gc:3s avg:10.7
0:09:24 INF [archive] - read 1x(8% 6s wait:1m16s done:3s)
0:09:24 INF [archive] - encode 11x(89% 1m17s)
0:09:24 INF [archive] - write 1x(4% 3s wait:1m21s)
0:09:24 INF [archive] - Finished in 9m24s cpu:34m1s gc:6s avg:3.6
0:09:24 INF [archive] - FINISHED!
0:09:24 INF [archive] -
0:09:24 INF [archive] - ----------------------------------------
0:09:24 INF [archive] - data errors:
0:09:24 INF [archive] - render_snap_fix_input 511,504
0:09:24 INF [archive] - osm_multipolygon_missing_way 1,914
0:09:24 INF [archive] - merge_snap_fix_input 151
0:09:24 INF [archive] - osm_boundary_missing_way 132
0:09:24 INF [archive] - feature_point_on_surface_osm_invalid_multipolygon_empty_after_fix 12
0:09:24 INF [archive] - osm_multipolygon_duplicate_member 10
0:09:24 INF [archive] - feature_polygon_osm_invalid_multipolygon_empty_after_fix 6
0:09:24 INF [archive] - osm_boundary_duplicate_member 2
0:09:24 INF [archive] - ----------------------------------------
0:09:24 INF [archive] - overall 9m24s cpu:34m1s gc:6s avg:3.6
0:09:24 INF [archive] - download 5m35s cpu:50s avg:0.1
0:09:24 INF [archive] - ne 13s cpu:18s avg:1.4
0:09:24 INF [archive] - read 1x(72% 9s done:3s)
0:09:24 INF [archive] - process 11x(2% 0.3s wait:9s done:3s)
0:09:24 INF [archive] - write 1x(0% 0s wait:9s done:3s)
0:09:24 INF [archive] - osm_pass1 8s cpu:47s avg:5.7
0:09:24 INF [archive] - read 1x(4% 0.3s wait:8s)
0:09:24 INF [archive] - parse 10x(42% 4s wait:4s)
0:09:24 INF [archive] - process 1x(90% 7s)
0:09:24 INF [archive] - osm_pass2 1m25s cpu:14m56s gc:2s avg:10.6
0:09:24 INF [archive] - read 1x(1% 0.4s wait:1m11s done:13s)
0:09:24 INF [archive] - process 11x(90% 1m17s)
0:09:24 INF [archive] - write 1x(19% 16s wait:1m6s)
0:09:24 INF [archive] - osm_water 8s cpu:23s avg:2.7
0:09:24 INF [archive] - read 1x(36% 3s done:5s)
0:09:24 INF [archive] - process 11x(12% 1s wait:2s done:5s)
0:09:24 INF [archive] - write 1x(0% 0s wait:5s done:4s)
0:09:24 INF [archive] - osm_land 7s cpu:16s avg:2.2
0:09:24 INF [archive] - read 1x(44% 3s done:4s)
0:09:24 INF [archive] - process 11x(11% 0.8s wait:3s done:4s)
0:09:24 INF [archive] - write 1x(1% 0.1s wait:4s done:3s)
0:09:24 INF [archive] - landcover 0.7s cpu:3s avg:4.1
0:09:24 INF [archive] - sort 8s cpu:52s avg:6.5
0:09:24 INF [archive] - worker 2x(41% 3s wait:3s)
0:09:24 INF [archive] - archive 1m27s cpu:15m28s gc:3s avg:10.7
0:09:24 INF [archive] - read 1x(8% 6s wait:1m16s done:3s)
0:09:24 INF [archive] - encode 11x(89% 1m17s)
0:09:24 INF [archive] - write 1x(4% 3s wait:1m21s)
0:09:24 INF [archive] - ----------------------------------------
0:09:24 INF [archive] - archive 1.7GB
0:09:24 INF [archive] - features 5.5GBI have this:
> aws s3 ls s3://serverlessmaps-prod-tilebucket-<SUFFIX>
2024-06-02 22:57:52 0 .gitkeep
2024-06-02 22:58:04 1799391370 us-northeast.pmtilesChecked the network tab, seems to think there's no content in any of these.
tobilg
commented
4 months ago Thanks for reporting! Could you please check whether setting the lat/lng coordniate in https://github.com/serverlessmaps/serverlessmaps/blob/main/website/index.html#L23 to a coordinate that matches the Geofabrik export (https://download.geofabrik.de/north-america/us-northeast.html)?
tolidano
commented
4 months ago I tried zooming all the way out and panning as well, nothing ever showed up. I will try what you suggest.
tolidano
commented
4 months ago Using a value did produce a response, but nothing visible.
tolidano
commented
4 months ago Should I delete it all and try again with Hamburg? One note is that I called the stage "prod" instead of "prd" in case that makes a difference.
tolidano
commented
4 months ago diff --git a/iac/serverless.yml b/iac/serverless.yml
index ad890b7..f09abd3 100644
--- a/iac/serverless.yml
+++ b/iac/serverless.yml
@@ -44,12 +44,12 @@ provider:
name: aws
runtime: nodejs18.x
region: ${env:REGION, 'us-east-1'}
- stage: ${env:STAGE, 'prd'}
+ stage: ${env:STAGE, 'prod'}
logRetentionInDays: 7
environment:
AWS_NODEJS_CONNECTION_REUSE_ENABLED: '1' # Enable HTTP keep-alive connections for the AWS SDK
STAGE: '${self:provider.stage}'
- LOG_LEVEL: 'debug'
+ LOG_LEVEL: 'warn'adding Hamburg, let's see.
tolidano
commented
4 months ago ok this works now in this view. but the other one does not, and still doesn't work when I flip to "us-northeast"
tobilg
commented
4 months ago The tile path is determined by the deployment at https://github.com/serverlessmaps/serverlessmaps/blob/main/iac/scripts/output.js#L14, meaning that you can only use one tileset in the current setup... So either hamburg or us-northeast.
tolidano
commented
4 months ago Ok, I'm saying it still doesn't work with protomaps-leaflet and only appears to work with maplibregl. The protomaps setup does not appear to work.
tobilg
commented
4 months ago Not sure what you mean by the last comment. Could you please describe again what you tried and what doesn’t work? After more than a dozen comments I‘m not really sure what I can do…
tolidano
commented
4 months ago I tried new-york and that worked on maplibregl as well. But I need it to work with us-northeast (or multiple states - new-york, new-jersey, and connecticut). Do you know how I might go about fixing it for us-northeast or making it work for multiple states at once?
tolidano
commented
4 months ago ok, scratch all of it. I just changed it from using protomaps@latest to protomaps@1.23.1 and everything works just fine, including us-northeast. You have to pin it because in 2+ it was renamed to protomaps-leaflet and does not work the same way anymore.
tobilg
commented
4 months ago Thanks for reporting back! I'll change the dependency accordingly...
Here is the output of my following the directions in the repo:
See screenshot:
I believe the issue is:
Cannot find "/dist/protomaps.min.js" in protomaps@2.0.1Which I see when I go here: https://d3gsiaxhde69bo.cloudfront.net/#0/-85/117