search

pelias / docker

Run the Pelias geocoder in docker containers, including example projects.
MIT License
330 stars 223 forks source link

API result doesn't have include city and no result from wof source #259

Closed mofm closed 3 years ago

mofm commented 3 years ago

I have built pelias with Docker "Quickstart build script". It works, no problem. But API result doesn't have include city, region, country and also no result specific wof source.

Example:

No city, region, country

-->result: https://gist.githubusercontent.com/mofm/fd123eb7926294d864e916234f471eb1/raw/64719d475b5332eef58d54a2307e36d44af19331/gistfile1.txt

and empty result with only wof source

--> result: https://gist.githubusercontent.com/mofm/07725a66172f9ed7a704c4d0ecddb007/raw/01c70ab0757fc7fb04d023c49b63c87773e451f6/gistfile1.txt

Sorry, I could not understand these issues.

Environment:

$ docker --version Docker version 20.10.5, build 55c4c88

$ docker-compose --version docker-compose version 1.28.5, build c4eb3a1f

$ pelias compose ps

        Name                      Command               State                        Ports                     
---------------------------------------------------------------------------------------------------------------
pelias_api             ./bin/start                      Up       0.0.0.0:4000->4000/tcp                        
pelias_csv_importer    /bin/bash                        Exit 0                                                 
pelias_elasticsearch   /usr/local/bin/docker-entr ...   Up       0.0.0.0:9200->9200/tcp, 0.0.0.0:9300->9300/tcp
pelias_interpolation   ./interpolate server /data ...   Up       0.0.0.0:4300->4300/tcp                        
pelias_libpostal       ./bin/wof-libpostal-server ...   Up       0.0.0.0:4400->4400/tcp                        
pelias_openaddresses   /bin/bash                        Exit 0                                                 
pelias_openstreetmap   /bin/bash                        Exit 0                                                 
pelias_pip-service     ./bin/start                      Up       0.0.0.0:4200->4200/tcp                        
pelias_placeholder     ./cmd/server.sh                  Up       0.0.0.0:4100->4100/tcp                        
pelias_polylines       /bin/bash                        Exit 0                                                 
pelias_schema          /bin/bash                        Exit 0                                                 
pelias_whosonfirst     /bin/bash                        Exit 0

pelias.json: https://gist.githubusercontent.com/mofm/99ab88c22890587534d86f0b286f53cf/raw/c3822d20e3a64457c0d060dc3582226932b5708b/pelias.json

if you want "compose or containers logs" i will send them as well. Thanks.

missinglink commented 3 years ago

Looking at the Geocode Earth servers I can see this is working as expected: https://pelias.github.io/compare/#/v1/autocomplete?boundary.country=tur&sources=wof&text=Civi

So I suspect that you have something misconfigured.

Pelias performs a 'Point in polygon' lookup for every record and uses the result to add the city/country/etc info to each record. I suspect the PIP service is disabled or incorrectly configured.

Can you please check the logs for anything mentioning 'PIP', also have a look at the start of the OpenStreetMap importer where it should print information about the PIP service.

mofm commented 3 years ago

Thanks @missinglink . I have checked pelias_pip-service container and it seems to be running.

$ docker logs pelias_pip-service

info: [wof-pip-service:master] starting with layers neighbourhood,borough,locality,localadmin,county,macrocounty,macroregion,region,dependency,country,empire,continent,marinearea,ocean
pip-service is now running on 0.0.0.0:4200
info: [wof-pip-service:master] marinearea worker loaded 0 features in 0.848 seconds
info: [wof-pip-service:master] region worker loaded 0 features in 0.245 seconds
info: [wof-pip-service:master] locality worker loaded 0 features in 0.983 seconds
info: [wof-pip-service:master] ocean worker loaded 0 features in 0.98 seconds
info: [wof-pip-service:master] borough worker loaded 0 features in 1.042 seconds
info: [wof-pip-service:master] macrocounty worker loaded 0 features in 1.025 seconds
info: [wof-pip-service:master] macroregion worker loaded 0 features in 1.035 seconds
info: [wof-pip-service:master] continent worker loaded 0 features in 1.056 seconds
info: [wof-pip-service:master] county worker loaded 0 features in 1.048 seconds
info: [wof-pip-service:master] neighbourhood worker loaded 0 features in 0.441 seconds
info: [wof-pip-service:master] empire worker loaded 0 features in 1.057 seconds
info: [wof-pip-service:master] localadmin worker loaded 0 features in 1.062 seconds
info: [wof-pip-service:master] country worker loaded 0 features in 0.4 seconds
info: [wof-pip-service:master] dependency worker loaded 0 features in 1.055 seconds
info: [wof-pip-service:master] PIP Service Loading Completed!!!
info: [wof-pip-service:master] starting with layers neighbourhood,borough,locality,localadmin,county,macrocounty,macroregion,region,dependency,country,empire,continent,marinearea,ocean
pip-service is now running on 0.0.0.0:4200
info: [wof-pip-service:master] macrocounty worker loaded 0 features in 0.01 seconds
info: [wof-pip-service:master] neighbourhood worker loaded 0 features in 0.024 seconds
info: [wof-pip-service:master] county worker loaded 0 features in 0.029 seconds
info: [wof-pip-service:master] locality worker loaded 0 features in 0.027 seconds
info: [wof-pip-service:master] country worker loaded 0 features in 0.01 seconds
info: [wof-pip-service:master] dependency worker loaded 0 features in 0.009 seconds
info: [wof-pip-service:master] localadmin worker loaded 0 features in 0.014 seconds
info: [wof-pip-service:master] ocean worker loaded 0 features in 0.01 seconds
info: [wof-pip-service:master] marinearea worker loaded 0 features in 6.161 seconds
info: [wof-pip-service:master] borough worker loaded 0 features in 1.764 seconds
info: [wof-pip-service:master] macroregion worker loaded 0 features in 0.011 seconds
info: [wof-pip-service:master] empire worker loaded 0 features in 0.995 seconds
info: [wof-pip-service:master] region worker loaded 0 features in 0.01 seconds
info: [wof-pip-service:master] continent worker loaded 0 features in 0.011 seconds
info: [wof-pip-service:master] PIP Service Loading Completed!!!

$ pelias compose top

pelias_api
UID    PID    PPID   C   STIME   TTY     TIME          CMD     
---------------------------------------------------------------
pgeo   2131   1947   0   13:01   ?     00:00:43   node index.js

pelias_elasticsearch
UID    PID    PPID   C   STIME   TTY     TIME                                                                                                 CMD                                                                                             
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
pgeo   2150   2021   0   13:01   ?     00:03:55   /usr/share/elasticsearch/jdk/bin/java -Des.networkaddress.cache.ttl=60 -Des.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8  
                                                  -Djna.nosys=true -XX:-OmitStackTraceInFastThrow -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dio.netty.recycler.maxCapacityPerThread=0                                    
                                                  -Dio.netty.allocator.numDirectArenas=0 -Dlog4j.shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Djava.locale.providers=COMPAT -Xms1g -Xmx1g -XX:+UseConcMarkSweepGC                     
                                                  -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -Djava.io.tmpdir=/tmp/elasticsearch-5540810562430734770 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=data      
                                                  -XX:ErrorFile=logs/hs_err_pid%p.log -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m -Des.cgroups.hierarchy.override=/ -Xms512m -Xmx512m        
                                                  -XX:MaxDirectMemorySize=268435456 -Des.path.home=/usr/share/elasticsearch -Des.path.conf=/usr/share/elasticsearch/config -Des.distribution.flavor=default -Des.distribution.type=docker     
                                                  -Des.bundled_jdk=true -cp /usr/share/elasticsearch/lib/* org.elasticsearch.bootstrap.Elasticsearch -Ecluster.name=pelias-dev -Ediscovery.type=single-node -Ebootstrap.memory_lock=true      
pgeo   2878   2150   0   13:01   ?     00:00:00   /usr/share/elasticsearch/modules/x-pack-ml/platform/linux-x86_64/bin/controller                                                                                                             

pelias_interpolation
UID    PID    PPID   C   STIME   TTY     TIME                                                       CMD                                                  
---------------------------------------------------------------------------------------------------------------------------------------------------------
pgeo   2143   2044   0   13:01   ?     00:00:00   /bin/bash ./interpolate server /data/interpolation/address.db /data/interpolation/street.db            
pgeo   2450   2143   0   13:01   ?     00:00:13   node /code/pelias/interpolation/cmd/server /data/interpolation/address.db /data/interpolation/street.db

pelias_libpostal
UID    PID    PPID   C   STIME   TTY     TIME                             CMD                        
-----------------------------------------------------------------------------------------------------
pgeo   2173   2039   0   13:01   ?     00:00:11   ./bin/wof-libpostal-server -host 0.0.0.0 -port 4400

pelias_pip-service
UID    PID    PPID   C   STIME   TTY     TIME                       CMD                  
-----------------------------------------------------------------------------------------
pgeo   3913   3880   0   21:55   ?     00:00:01   node --max_old_space_size=8000 index.js
pgeo   3989   3913   0   21:55   ?     00:00:00   neighbourhood                          
pgeo   3990   3913   0   21:55   ?     00:00:09   borough                                
pgeo   3996   3913   0   21:55   ?     00:00:00   locality                               
pgeo   3998   3913   0   21:55   ?     00:00:02   localadmin                             
pgeo   4009   3913   0   21:55   ?     00:00:04   county                                 
pgeo   4011   3913   0   21:55   ?     00:00:00   macrocounty                            
pgeo   4024   3913   0   21:55   ?     00:00:07   macroregion                            
pgeo   4031   3913   1   21:55   ?     00:00:10   region                                 
pgeo   4038   3913   0   21:55   ?     00:00:00   dependency                             
pgeo   4040   3913   0   21:55   ?     00:00:00   country                                
pgeo   4051   3913   0   21:55   ?     00:00:05   empire                                 
pgeo   4054   3913   0   21:55   ?     00:00:07   continent                              
pgeo   4061   3913   0   21:55   ?     00:00:04   marinearea                             
pgeo   4067   3913   0   21:55   ?     00:00:04   ocean                                  

pelias_placeholder
UID    PID    PPID   C   STIME   TTY     TIME                                 CMD                            
-------------------------------------------------------------------------------------------------------------
pgeo   2126   1946   0   13:01   ?     00:00:01   node server/http.js                                        
pgeo   2713   2126   0   13:01   ?     00:00:01   /usr/local/bin/node /code/pelias/placeholder/server/http.js
pgeo   2714   2126   0   13:01   ?     00:00:01   /usr/local/bin/node /code/pelias/placeholder/server/http.js
pgeo   2720   2126   0   13:01   ?     00:00:02   /usr/local/bin/node /code/pelias/placeholder/server/http.js
pgeo   2726   2126   0   13:01   ?     00:00:02   /usr/local/bin/node /code/pelias/placeholder/server/http.js

But i have found new issue, parse button(function) is not working in the placeholder( http://localhost::4100/demo/#eng)

Where should I look for the Openstreetmap importer outputs?

mofm commented 3 years ago

I solved this issue. I forgot to add WOF country ID. Thanks @missinglink .