Download Openaddress quitting - took so long - Manual Download Possibility

[danirisdiandita]

Hi, I am trying to install pelias through docker-compose, I tried to create Indonesian geocoding by reproducing the project for germany. However, it stucks during pelias download all, all data can be downloaded successfully with openaddresses stop downloading. here below my steps by steps:

1. bug descriptions: docker installation, stuck during pelias download all while downloading openaddress

               Name                               Command               State                         Ports                       
   -----------------------------------------------------------------------------------------------------------------------------------
   pelias_elasticsearch                    /bin/tini -- /usr/local/bi ...   Up      127.0.0.1:9200->9200/tcp, 127.0.0.1:9300->9300/tcp
   pelias_openaddresses_run_43a1b5017ff6   ./bin/download                   Up                                                        
   >>> /projects/indonesia$ docker logs pelias_openaddresses_run_43a1b5017ff6
   info: [openaddresses-download] Attempting to download all data
   debug: [openaddresses-download] downloading https://data.openaddresses.io/openaddr-collected-global.zip

   i don't find the downloaded file, I believe that due to the network quota of the openaddress. downloading manually took so long.

2. steps to reproduce: installation through docker in https://github.com/pelias/docker , everything is fine until pelias download all
3. Expected behaviour: downloaded to the ./data/ directory.
4. Question: can I download manually then put the zip file to the ./data/openaddress folder to continue the installation?

[missinglink]

Please post your pelias.json file.

[danirisdiandita]

hi @missinglink , here we go

{
    "logger": {
        "level": "debug",
        "timestamp": false
    },
    "esclient": {
        "apiVersion": "7.5",
        "hosts": [
            { "host": "elasticsearch" }
        ]
    },
    "elasticsearch": {
        "settings": {
            "index": {
                "refresh_interval": "10s",
                "number_of_replicas": "0",
                "number_of_shards": "1"
            }
        }
    },
    "api": {
        "services": {
            "pip": { "url": "http://pip:4200" },
            "libpostal": { "url": "http://libpostal:4400" },
            "placeholder": { "url": "http://placeholder:4100" },
            "interpolation": { "url": "http://interpolation:4300" }
        }
    },
    "imports": {
        "geonames": {
            "datapath": "/data/geonames",
            "countryCode": "ID"
        },
        "openstreetmap": {
            "download": [
                { "sourceURL": "https://download.geofabrik.de/asia/indonesia-latest.osm.pbf" }
            ],
            "leveldbpath": "/tmp",
            "datapath": "/data/openstreetmap",
            "import": [{
                "filename": "indonesia-latest.osm.pbf"
            }]
        },
        "openaddresses": {
            "datapath": "/data/openaddresses",
            "files": []
        },
        "polyline": {
            "datapath": "/data/polylines",
            "files": ["extract.0sv"]
        },
        "whosonfirst": {
            "datapath": "/data/whosonfirst",
            "countryCode": "ID",
            "importPostalcodes": true
        }
    }
}

[missinglink]

Looking through the OpenAddresses Data, there appears to be no data for Indonesia.

So the good news is you don't need to download anything, the bad news is you'll have to rely solely on OpenStreetMap for addresses.

Instead of running pelias download all, you can run the other sources individually, eg:

pelias download wof
pelias download osm
pelias download geonames

[danirisdiandita]

I see, thanks @missinglink , I will close this issue tho