Closed robertdcurrier closed 5 years ago
benjwadams
commented
6 years ago Robert, could you try deleting all the containers related to CKAN, rerunning docker compose up and sending your logs from the docker-compose up (via | tee logs.txt or > logs.txt or so)
robertdcurrier
commented
6 years ago Will do. Just pruned all my unused images so this would be a good time to test. Will send the logging data after I test.
Bob
On Tue, May 29, 2018 at 9:29 AM, Benjamin Adams notifications@github.com wrote:
Robert, could you try deleting all the containers related to CKAN, rerunning docker compose up and sending your logs from the docker-compose up (via | tee logs.txt or > logs.txt or so)
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/ioos/catalog-ckan/issues/181#issuecomment-392776860, or mute the thread https://github.com/notifications/unsubscribe-auth/AA8CVKuujMdyt5MKQ_6sHvAXA2cTsKp0ks5t3U04gaJpZM4TxDut .
robertdcurrier
commented
6 years ago Attached. Clean install and the same results here on my local Ubuntu 16.04 as on the D.O. droplet I was testing previously.
Bob
On Tue, May 29, 2018 at 9:29 AM, Benjamin Adams notifications@github.com wrote:
Robert, could you try deleting all the containers related to CKAN, rerunning docker compose up and sending your logs from the docker-compose up (via | tee logs.txt or > logs.txt or so)
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/ioos/catalog-ckan/issues/181#issuecomment-392776860, or mute the thread https://github.com/notifications/unsubscribe-auth/AA8CVKuujMdyt5MKQ_6sHvAXA2cTsKp0ks5t3U04gaJpZM4TxDut .
Attaching to postgis, pycsw, ckan, harvester, redis, solr
[36mpostgis |[0m LOG: database system was shut down at 2018-05-29 13:45:01 UTC
[33mpycsw |[0m Running /etc/my_init.d/20_wait_for_postgres_tables...
[36mpostgis |[0m LOG: MultiXact member wraparound protections are now enabled
[33mpycsw |[0m + export PGPASSWORD=ckanpass
[32mckan |[0m Running /etc/my_init.d/50_configure...
[33mpycsw |[0m + PGPASSWORD=ckanpass
[36mpostgis |[0m LOG: autovacuum launcher started
[32mckan |[0m + CONFIG=/etc/ckan/default/ckan.ini
[31mredis |[0m 1:C 29 May 13:45:18.044 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
[35mharvester |[0m Running /etc/my_init.d/20_wait_for_postgres_tables...
[33mpycsw |[0m + run_psqlckan='psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c'
[36mpostgis |[0m LOG: database system is ready to accept connections
[31mredis |[0m .
[35mharvester |[0m + export PGPASSWORD=ckanpass
[33mpycsw |[0m + true
[31mredis |[0m .-__ ''-._ [35mharvester |[0m + PGPASSWORD=ckanpass [31mredis |[0m _.- .. ''-. Redis 3.0.7 (00000000/0) 64 bit
[36mpostgis |[0m FATAL: password authentication failed for user "root"
[32mckan |[0m + '[' '!' -e /etc/ckan/default/ckan.ini ']'
[33mpycsw |[0m ++ psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c 'SELECT 1 from information_schema.tables WHERE table_name = '\''harvest_object_extra'\'''
[35mharvester |[0m + run_psqlckan='psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c'
[31mredis |[0m .-`` .-.\/ ., ''-.
[36mpostgis |[0m DETAIL: Connection matched pg_hba.conf line 95: "host all all all md5"
[32mckan |[0m + echo 'CKAN_DEBUG: false'
[35mharvester |[0m + true
[31mredis |[0m ( ' , .-|, ) Running in standalone mode
[32mckan |[0m CKANDEBUG: false
[33mpycsw |[0m + result=
[31mredis |[0m |`-.-...- _...-.``-.|'_.-'| Port: 6379 [33mpycsw |[0m + [[ '' == \1 ]] [31mredis |[0m |-. `. / _.-' | PID: 1
[32mckan |[0m + '[' false == true ']'
[35mharvester |[0m ++ psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c 'SELECT 1 from information_schema.tables WHERE table_name = '\''harvest_objectextra'\'''
[33mpycsw |[0m + echo 'Waiting for all ckan tables to initialize'
[31mredis |[0m `-. -._-./ .-' .-'
[35mharvester |[0m + result=
[32mckan |[0m + '[' '!' -e /etc/ckan/default/pycsw.cfg ']'
[31mredis |[0m |-._-._ -.__.-' _.-'_.-'| [35mharvester |[0m + [[ '' == \1 ]] [33mpycsw |[0m Waiting for all ckan tables to initialize [31mredis |[0m |-.`-. .-'.-' | http://redis.io
[32mckan |[0m + ln -s /usr/lib/ckan/default/src/pycsw/default.cfg /etc/ckan/default/pycsw.cfg
[31mredis |[0m -._-._`-._.-'.-' _.-'
[35mharvester |[0m + echo 'Waiting for all ckan tables to initialize'
[33mpycsw |[0m + sleep 20
[32mckan |[0m Running /etc/my_init.d/60initdb...
[31mredis |[0m |`-.-._-..-' .-'.-'|
[35mharvester |[0m + sleep 20
[31mredis |[0m | -._-. .-'.-' |
[31mredis |[0m `-. -._-..-'.-' .-'
[32mckan |[0m + : true
[31mredis |[0m -._-..-' .-'
[32mckan |[0m + export PGPASSWORD=ckanpass
[35mharvester |[0m Waiting for all ckan tables to initialize
[31mredis |[0m `-. _.-'
[32mckan |[0m + PGPASSWORD=ckanpass
[32mckan |[0m + fail_counter=0
[31mredis |[0m `-..-'
[32mckan |[0m + run_psql='psql -h postgis -p 5432 -U ckanadmin postgres -qAt -c'
[31mredis |[0m
[32mckan |[0m + run_psql_ckan='psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c'
[31mredis |[0m 1:M 29 May 13:45:18.047 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
[31mredis |[0m 1:M 29 May 13:45:18.047 # Server started, Redis version 3.0.7
[32mckan |[0m + true
[32mckan |[0m + [[ 0 -gt 10 ]]
[31mredis |[0m 1:M 29 May 13:45:18.047 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
[31mredis |[0m 1:M 29 May 13:45:18.047 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
[32mckan |[0m + pg_isready -h postgis -p 5432 -d ckan
[31mredis |[0m 1:M 29 May 13:45:18.047 DB loaded from disk: 0.000 seconds
[32mckan |[0m postgis:5432 - accepting connections
[32mckan |[0m ++ psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c 'SELECT 1 FROM pg_extension where extname = '\''postgis'\'''
[31mredis |[0m 1:M 29 May 13:45:18.047 The server is now ready to accept connections on port 6379
[32mckan |[0m + postgis_stat=1
[32mckan |[0m + [[ 1 = \1 ]]
[32mckan |[0m + break
[32mckan |[0m + [[ true = \t\r\u\e ]]
[32mckan |[0m + /usr/lib/ckan/default/bin/paster --plugin=ckan db init -c /etc/ckan/default/ckan.ini
[34msolr |[0m 0 [main] INFO org.eclipse.jetty.server.Server ? jetty-8.1.10.v20130312
[34msolr |[0m 14 [main] INFO org.eclipse.jetty.deploy.providers.ScanningAppProvider ? Deployment monitor /opt/solr/example/contexts at interval 0
[34msolr |[0m 18 [main] INFO org.eclipse.jetty.deploy.DeploymentManager ? Deployable added: /opt/solr/example/contexts/solr-jetty-context.xml
[32mckan |[0m 2018-05-29 13:45:19,729 ERROR [ckan.lib.search.common] [Errno 111] Connection refused
[32mckan |[0m Traceback (most recent call last):
[32mckan |[0m File "/usr/lib/ckan/default/src/ckan/ckan/lib/search/common.py", line 51, in is_available
[32mckan |[0m conn.query(":", rows=1)
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 703, in query
[32mckan |[0m return self.select(args, params)
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 798, in call
[32mckan |[0m xml = self.raw(params)
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 823, in raw
[32mckan |[0m rsp = conn._post(self.selector, request, conn.form_headers)
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 646, in _post
[32mckan |[0m self._reconnect()
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 625, in _reconnect
[32mckan |[0m self.conn.connect()
[32mckan |[0m File "/usr/lib/python2.7/httplib.py", line 807, in connect
[32mckan |[0m self.timeout, self.source_address)
[32mckan |[0m File "/usr/lib/python2.7/socket.py", line 571, in create_connection
[32mckan |[0m raise err
[32mckan |[0m error: [Errno 111] Connection refused
[32mckan |[0m 2018-05-29 13:45:19,730 WARNI [ckan.lib.search] Problems were found while connecting to the SOLR server
[36mpostgis |[0m ERROR: relation "user" does not exist at character 465
[36mpostgis |[0m STATEMENT: SELECT "user".password AS user_password, "user".id AS user_id, "user".name AS user_name, "user".openid AS user_openid, "user".fullname AS user_fullname, "user".email AS user_email, "user".apikey AS user_apikey, "user".created AS user_created, "user".reset_key AS user_reset_key, "user".about AS user_about, "user".activity_streams_email_notifications AS user_activity_streams_email_notifications, "user".sysadmin AS user_sysadmin, "user".state AS user_state
[36mpostgis |[0m FROM "user"
[36mpostgis |[0m WHERE "user".name = 'default' OR "user".openid = 'default' OR "user".id = 'default' ORDER BY "user".name
[36mpostgis |[0m LIMIT 1
[32mckan |[0m 2018-05-29 13:45:20,106 ERROR [ckan.lib.search.common] [Errno 111] Connection refused
[32mckan |[0m Traceback (most recent call last):
[32mckan |[0m File "/usr/lib/ckan/default/src/ckan/ckan/lib/search/common.py", line 51, in is_available
[32mckan |[0m conn.query(":", rows=1)
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 703, in query
[32mckan |[0m return self.select(args, params)
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 798, in call
[32mckan |[0m xml = self.raw(params)
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 823, in raw
[32mckan |[0m rsp = conn._post(self.selector, request, conn.form_headers)
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 646, in _post
[32mckan |[0m self._reconnect()
[32mckan |[0m File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/solr/core.py", line 625, in _reconnect
[32mckan |[0m self.conn.connect()
[32mckan |[0m File "/usr/lib/python2.7/httplib.py", line 807, in connect
[32mckan |[0m self.timeout, self.source_address)
[32mckan |[0m File "/usr/lib/python2.7/socket.py", line 571, in create_connection
[32mckan |[0m raise err
[32mckan |[0m error: [Errno 111] Connection refused
[32mckan |[0m 2018-05-29 13:45:20,106 WARNI [ckan.lib.search] Problems were found while connecting to the SOLR server
[32mckan |[0m 2018-05-29 13:45:20,152 DEBUG [ckanext.spatial.plugin] Setting up the spatial model
[32mckan |[0m 2018-05-29 13:45:20,191 DEBUG [ckanext.spatial.model.package_extent] Spatial tables defined in memory
[32mckan |[0m 2018-05-29 13:45:20,196 DEBUG [ckanext.spatial.model.package_extent] Spatial tables creation deferred
[32mckan |[0m 2018-05-29 13:45:20,206 DEBUG [ckanext.harvest.model] Harvest tables defined in memory
[32mckan |[0m 2018-05-29 13:45:20,207 DEBUG [ckanext.harvest.model] Harvest table creation deferred
[32mckan |[0m Traceback (most recent call last):
[32mckan |[0m File "/usr/lib/ckan/default/bin/paster", line 11, in
benjwadams
commented
6 years ago It's an unhandled exception related to Google Analytics related code (for determining popularity of datasets, etc.)
[32mckan |[0m raise GoogleAnalyticsException(msg) [32mckan |[0m ckanext.googleanalytics.plugin.GoogleAnalyticsException: Missing googleanalytics.id in config
I will take a look next week.
robertdcurrier
commented
6 years ago Much obliged.
On June 1, 2018, at 8:29 PM, Benjamin Adams notifications@github.com wrote:
It's an unhandled exception related to Google Analytics related code (for determining popularity of datasets, etc.)
[32mckan |[0m raise GoogleAnalyticsException(msg) [32mckan |[0m ckanext.googleanalytics.plugin.GoogleAnalyticsException: Missing googleanalytics.id in config
I will take a look next week.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.
{"@context":"http://schema.org","@type":"EmailMessage","potentialAction":{"@type":"ViewAction","target":"https://github.com/ioos/catalog-ckan/issues/181#issuecomment-394041896","url":"https://github.com/ioos/catalog-ckan/issues/181#issuecomment-394041896","name":"View Issue"},"description":"View this Issue on GitHub","publisher":{"@type":"Organization","name":"GitHub","url":"https://github.com"}} {"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/ioos/catalog-ckan","title":"ioos/catalog-ckan","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/ioos/catalog-ckan"}},"updates":{"snippets":[{"icon":"PERSON","message":"@benjwadams in #181: It's an unhandled exception related to Google Analytics related code (for determining popularity of datasets, etc.)\r\n\r\n[32mckan |[0m raise GoogleAnalyticsException(msg) [32mckan |[0m ckanext.googleanalytics.plugin.GoogleAnalyticsException: Missing <a href="http://googleanalytics.id">googleanalytics.id</a> in config\r\n\r\nI will take a look next week."}],"action":{"name":"View Issue","url":"https://github.com/ioos/catalog-ckan/issues/181#issuecomment-394041896"}}} { "@type": "MessageCard", "@context": "http://schema.org/extensions", "hideOriginalBody": "false", "originator": "37567f93-e2a7-4e2a-ad37-a9160fc62647", "title": "Re: [ioos/catalog-ckan] hangs on 'Waiting for all ckan tables to initialize' (#181)", "sections": [ { "text": "", "activityTitle": "Benjamin Adams", "activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png", "activitySubtitle": "@benjwadams", "facts": [ ] } ], "potentialAction": [ { "name": "Add a comment", "@type": "ActionCard", "inputs": [ { "isMultiLine": true, "@type": "TextInput", "id": "IssueComment", "isRequired": false } ], "actions": [ { "name": "Comment", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"IssueComment\",\n\"repositoryFullName\": \"ioos/catalog-ckan\",\n\"issueId\": 181,\n\"IssueComment\": \"{{IssueComment.value}}\"\n}" } ] }, { "name": "Close issue", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"IssueClose\",\n\"repositoryFullName\": \"ioos/catalog-ckan\",\n\"issueId\": 181\n}" }, { "targets": [ { "os": "default", "uri": "https://github.com/ioos/catalog-ckan/issues/181#issuecomment-394041896" } ], "@type": "OpenUri", "name": "View on GitHub" }, { "name": "Unsubscribe", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"MuteNotification\",\n\"threadId\": 331627437\n}" } ], "themeColor": "26292E" }
benjwadams
commented
6 years ago I forgot to update this issue -- Last month I made a PR in another repo connected to this one which will likely fix the issues with the Docker build.
benjwadams
commented
5 years ago Issue is no longer relevant with new build process. I will be updating the documentation to better describe the build process steps.
IOOS CKAN folks,
Tried this on both CentOS-7 and Ubuntu 16.04 with the same results. Created the two networks, ran sudo docker-compose up and all goes well until we fall into n-dimensional bunny space looping over 'waiting for all ckan tables to initialize.' Any thoughts? Thanks in advance for any suggestions...
harvester | + true harvester | ++ psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c 'SELECT 1 from information_schema.tables WHERE table_name = '\''harvest_object_extra'\''' harvester | Waiting for all ckan tables to initialize harvester | + result= harvester | + [[ '' == \1 ]] harvester | + echo 'Waiting for all ckan tables to initialize' harvester | + sleep 20 pycsw | + true pycsw | ++ psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c 'SELECT 1 from information_schema.tables WHERE table_name = '\''harvest_object_extra'\''' pycsw | + result= pycsw | + [[ '' == \1 ]] pycsw | + echo 'Waiting for all ckan tables to initialize' pycsw | + sleep 20 pycsw | Waiting for all ckan tables to initialize harvester | + true harvester | ++ psql -h postgis -p 5432 -U ckanadmin ckan -qAt -c 'SELECT 1 from information_schema.tables WHERE table_name = '\''harvest_object_extra'\''' harvester | + result= harvester | + [[ '' == \1 ]] harvester | + echo 'Waiting for all ckan tables to initialize' harvester | + sleep 20 harvester | Waiting for all ckan tables to initialize