search

klokantech / osmnames-sphinxsearch

Geocoder search engine for OSMNames.org data powered by sphinx search
https://osmnames.org/
MIT License
77 stars 24 forks source link

Docker image klokantech/osmnames-sphinxsearch:latest not working #49

Closed SantiagoHorcajo closed 7 years ago

SantiagoHorcajo commented 7 years ago

Hi. I've got some issues trying to test this project. At this moment I have tried latest, 2.0.1, 2.0 and 1.4 docker versions. I couln't put to work latest, 2.0.1 and 2.0, but 1.4 worked fine. This is my environment:

This is the process I followed as detailed as possible:

# rm /var/lib/docker/klokantech_osmnames/data/input/*
# docker system prune -a
# docker pull klokantech/osmnames-sphinxsearch:latest
# docker run -it -p 80:80 -v /var/lib/docker/klokantech_osmnames/data/input:/data/input/ --name klokantech_osmnames-sphinxsearch klokantech/osmnames-sphinxsearch:latest
2017-10-24 11:37:23,369 CRIT Supervisor running as root (no user in config file)
2017-10-24 11:37:23,370 INFO Included extra file "/etc/supervisor/conf.d/nginx.conf" during parsing
2017-10-24 11:37:23,370 INFO Included extra file "/etc/supervisor/conf.d/sphinx.conf" during parsing
2017-10-24 11:37:23,370 INFO Included extra file "/etc/supervisor/conf.d/web.conf" during parsing
2017-10-24 11:37:23,398 INFO RPC interface 'supervisor' initialized
2017-10-24 11:37:23,402 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2017-10-24 11:37:23,402 INFO supervisord started with pid 1
2017-10-24 11:37:24,404 INFO spawned: 'indexer' with pid 7
2017-10-24 11:37:24,405 INFO spawned: 'nginx' with pid 8
2017-10-24 11:37:24,407 INFO spawned: 'websearch' with pid 9
2017-10-24 11:37:26,102 INFO success: indexer entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2017-10-24 11:37:26,102 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2017-10-24 11:37:26,102 INFO success: websearch entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2017-10-24 11:37:37,879 INFO spawned: 'sphinx' with pid 105
2017-10-24 11:37:38,980 INFO success: sphinx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2017-10-24 11:37:39,003 INFO exited: indexer (exit status 0; expected)
2017-10-24 11:37:39,004 INFO reaped unknown pid 10

In another terminal:

# ls -l /var/lib/docker/klokantech_osmnames/data/input/
total 19248
-rw-r--r-- 2 root root 9851341 Oct 24 12:37 data.tsv.gz
-rw-r--r-- 2 root root 9851341 Oct 24 12:37 planet-latest-100k.tsv.gz
# find / -name sphinx-reindex.log
/var/lib/docker/aufs/diff/95df547128df0b5e48f3de3f6832d755e00cb8c1dd61527bb58e9bcff21c8e2e/var/log/sphinxsearch/sphinx-reindex.log
/var/lib/docker/aufs/mnt/95df547128df0b5e48f3de3f6832d755e00cb8c1dd61527bb58e9bcff21c8e2e/var/log/sphinxsearch/sphinx-reindex.log
# cat /var/lib/docker/aufs/diff/95df547128df0b5e48f3de3f6832d755e00cb8c1dd61527bb58e9bcff21c8e2e/var/log/sphinxsearch/sphinx-reindex.log
Started: 20171024 113724
Reindex started: 20171024 113729
Sphinx 2.2.11-id64-release (95ae9a6)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)

using config file '/etc/sphinxsearch/sphinx.conf'...
WARNING: key 'charset_type' was permanently removed from Sphinx configuration. Refer to documentation for details.
WARNING: key 'charset_type' was permanently removed from Sphinx configuration. Refer to documentation for details.
indexing index 'ind_charset'...
ERROR: index 'ind_charset': key 'path' not found.
indexing index 'ind_main_charset'...
ERROR: index 'ind_main_charset': key 'path' not found.
indexing index 'ind_name_exact_0'...
WARNING: index 'ind_name_exact_0': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_name_exact_0': source 'src_name_0': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.533 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_name_prefix_0'...
WARNING: index 'ind_name_prefix_0': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_name_prefix_0': source 'src_name_0': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.457 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_names_prefix_0'...
WARNING: index 'ind_names_prefix_0': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_names_prefix_0': source 'src_names_full_0': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.555 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_names_infix_soundex_0'...
ERROR: index 'ind_names_infix_soundex_0': source 'src_names_full_0': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.519 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_name_exact_1'...
WARNING: index 'ind_name_exact_1': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_name_exact_1': source 'src_name_1': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.438 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_name_prefix_1'...
WARNING: index 'ind_name_prefix_1': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_name_prefix_1': source 'src_name_1': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.641 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_names_prefix_1'...
WARNING: index 'ind_names_prefix_1': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_names_prefix_1': source 'src_names_full_1': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.565 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_names_infix_soundex_1'...
ERROR: index 'ind_names_infix_soundex_1': source 'src_names_full_1': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.486 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_name_exact_2'...
WARNING: index 'ind_name_exact_2': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_name_exact_2': source 'src_name_2': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.552 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_name_prefix_2'...
WARNING: index 'ind_name_prefix_2': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_name_prefix_2': source 'src_name_2': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.474 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_names_prefix_2'...
WARNING: index 'ind_names_prefix_2': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_names_prefix_2': source 'src_names_full_2': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.435 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_names_infix_soundex_2'...
ERROR: index 'ind_names_infix_soundex_2': source 'src_names_full_2': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.607 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_name_exact_3'...
WARNING: index 'ind_name_exact_3': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_name_exact_3': source 'src_name_3': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.527 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_name_prefix_3'...
WARNING: index 'ind_name_prefix_3': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_name_prefix_3': source 'src_name_3': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.466 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_names_prefix_3'...
WARNING: index 'ind_names_prefix_3': no morphology or wordforms, index_exact_words=1 has no effect, ignoring
ERROR: index 'ind_names_prefix_3': source 'src_names_full_3': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.524 sec, 0 bytes/sec, 0.00 docs/sec
indexing index 'ind_names_infix_soundex_3'...
ERROR: index 'ind_names_infix_soundex_3': source 'src_names_full_3': read error 'No child processes'.
total 0 docs, 0 bytes
total 0.490 sec, 0 bytes/sec, 0.00 docs/sec
skipping non-plain index 'ind_name_exact'...
skipping non-plain index 'ind_names_infix_soundex'...
skipping non-plain index 'ind_name_prefix'...
skipping non-plain index 'ind_names_prefix'...
total 0 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
total 0 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
Reindex finished: 20171024 113737
sphinx: started
Finished: 20171024 113738
#

And finally, in the browser I submitted the following search with subsequent response:

/q/rome.js
message "(1064, 'no enabled local indexes to search')"

Thanks for your extraordinary work. Regards, Santiago

MartinMikita commented 7 years ago

Hi Santiago,

You need to get the latest data from https://github.com/OSMNames/OSMNames/releases There were new releases without prepared sample of the first 100k entries, which are downloaded automatically in the reindex script

You could either download the full planet release or wait a few days, while we will prepare the sample and upload it to the server.

Docker images 2.0+ requires OSMNames 2.0 version data, because of the changed structure of the CSV.

SantiagoHorcajo commented 7 years ago

Tested your solution. Thanks.