search

steemit / sbds

Steem Blockchain Data Service
https://developers.steem.io/#services-sbds
Other
37 stars 23 forks source link

does not synchronize #83

Closed sneak closed 6 years ago

sneak commented 6 years ago 
Creating contrib_db_1 ... 
Creating contrib_db_1 ... done
Creating contrib_sbds_1 ... 
Creating contrib_sbds_1 ... done
Attaching to contrib_db_1, contrib_sbds_1
db_1    | Initializing database
db_1    | 2017-11-11T18:28:04.456208Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
sbds_1  | *** Running /etc/my_init.d/00_regen_ssh_host_keys.sh...
sbds_1  | *** Running /etc/rc.local...
sbds_1  | *** Booting runit daemon...
db_1    | 2017-11-11T18:28:04.665707Z 0 [Warning] InnoDB: New log files created, LSN=45790
sbds_1  | *** Runit started as PID 7
sbds_1  | *** Starting uWSGI 2.0.15 (64bit) on [Sat Nov 11 18:28:04 2017] ***
sbds_1  | compiled with version: 5.4.0 20160609 on 28 October 2017 06:56:22
sbds_1  | os: Linux-4.4.93-boot2docker #1 SMP Wed Oct 18 17:00:16 UTC 2017
sbds_1  | nodename: 8d6e608cf7ab
sbds_1  | machine: x86_64
sbds_1  | clock source: unix
sbds_1  | pcre jit disabled
sbds_1  | detected number of CPU cores: 1
sbds_1  | current working directory: /etc/service/sbds-web
sbds_1  | detected binary path: /usr/local/bin/uwsgi
sbds_1  | your processes number limit is 1048576
sbds_1  | your memory page size is 4096 bytes
sbds_1  | detected max file descriptor number: 1048576
sbds_1  | lock engine: pthread robust mutexes
sbds_1  | thunder lock: disabled (you can enable it with --thunder-lock)
sbds_1  | uWSGI http bound on :8080 fd 4
sbds_1  | uwsgi socket 0 bound to TCP address 127.0.0.1:45444 (port auto-assigned) fd 3
db_1    | 2017-11-11T18:28:04.713737Z 0 [Warning] InnoDB: Creating foreign key constraint system tables.
db_1    | 2017-11-11T18:28:04.786120Z 0 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: 0eae437b-c70e-11e7-9b80-0242ac130002.
db_1    | 2017-11-11T18:28:04.789586Z 0 [Warning] Gtid table is not ready to be used. Table 'mysql.gtid_executed' cannot be opened.
sbds_1  | Python version: 3.5.2 (default, Sep 14 2017, 22:51:06)  [GCC 5.4.0 20160609]
sbds_1  | Python main interpreter initialized at 0x146a5d0
sbds_1  | python threads support enabled
sbds_1  | your server socket listen backlog is limited to 100 connections
sbds_1  | your mercy for graceful operations on workers is 60 seconds
sbds_1  | mapped 654912 bytes (639 KB) for 8 cores
db_1    | 2017-11-11T18:28:04.790727Z 1 [Warning] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option.
sbds_1  | *** Operational MODE: preforking ***
db_1    | 2017-11-11T18:28:05.470300Z 1 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:05.470412Z 1 [Warning] 'user' entry 'mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:05.470432Z 1 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:05.470451Z 1 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:05.470462Z 1 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:05.470473Z 1 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:05.470501Z 1 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:05.470513Z 1 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | Database initialized
db_1    | Initializing certificates
db_1    | Generating a 2048 bit RSA private key
db_1    | ............+++
db_1    | .......................................+++
db_1    | unable to write 'random state'
db_1    | writing new private key to 'ca-key.pem'
db_1    | -----
db_1    | Generating a 2048 bit RSA private key
db_1    | ............+++
db_1    | ................+++
db_1    | unable to write 'random state'
db_1    | writing new private key to 'server-key.pem'
db_1    | -----
db_1    | Generating a 2048 bit RSA private key
db_1    | ........+++
db_1    | ..................+++
db_1    | unable to write 'random state'
db_1    | writing new private key to 'client-key.pem'
db_1    | -----
db_1    | Certificates initialized
db_1    | MySQL init process in progress...
db_1    | 2017-11-11T18:28:08.226722Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
db_1    | 2017-11-11T18:28:08.228381Z 0 [Note] mysqld (mysqld 5.7.20) starting as process 87 ...
db_1    | 2017-11-11T18:28:08.237270Z 0 [Note] InnoDB: PUNCH HOLE support available
db_1    | 2017-11-11T18:28:08.237303Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
db_1    | 2017-11-11T18:28:08.237314Z 0 [Note] InnoDB: Uses event mutexes
db_1    | 2017-11-11T18:28:08.237324Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
db_1    | 2017-11-11T18:28:08.237332Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
db_1    | 2017-11-11T18:28:08.237340Z 0 [Note] InnoDB: Using Linux native AIO
db_1    | 2017-11-11T18:28:08.237482Z 0 [Note] InnoDB: Number of pools: 1
db_1    | 2017-11-11T18:28:08.237555Z 0 [Note] InnoDB: Using CPU crc32 instructions
db_1    | 2017-11-11T18:28:08.238836Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
db_1    | 2017-11-11T18:28:08.244582Z 0 [Note] InnoDB: Completed initialization of buffer pool
db_1    | 2017-11-11T18:28:08.256104Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
db_1    | 2017-11-11T18:28:08.267648Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
db_1    | 2017-11-11T18:28:08.275206Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
db_1    | 2017-11-11T18:28:08.275325Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
db_1    | 2017-11-11T18:28:08.303591Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
db_1    | 2017-11-11T18:28:08.304128Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
db_1    | 2017-11-11T18:28:08.304151Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
db_1    | 2017-11-11T18:28:08.304504Z 0 [Note] InnoDB: Waiting for purge to start
db_1    | 2017-11-11T18:28:08.355270Z 0 [Note] InnoDB: 5.7.20 started; log sequence number 2565377
db_1    | 2017-11-11T18:28:08.355646Z 0 [Note] Plugin 'FEDERATED' is disabled.
db_1    | 2017-11-11T18:28:08.360999Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
db_1    | 2017-11-11T18:28:08.365016Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
db_1    | 2017-11-11T18:28:08.366220Z 0 [Note] InnoDB: Buffer pool(s) load completed at 171111 18:28:08
db_1    | 2017-11-11T18:28:08.367056Z 0 [Warning] CA certificate ca.pem is self signed.
db_1    | 2017-11-11T18:28:08.383389Z 0 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:08.383493Z 0 [Warning] 'user' entry 'mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:08.383512Z 0 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:08.383530Z 0 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:08.383540Z 0 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:08.383552Z 0 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:08.384273Z 0 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:08.384293Z 0 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:08.387722Z 0 [Note] Event Scheduler: Loaded 0 events
db_1    | 2017-11-11T18:28:08.397918Z 0 [Note] mysqld: ready for connections.
db_1    | Version: '5.7.20'  socket: '/var/run/mysqld/mysqld.sock'  port: 0  MySQL Community Server (GPL)
db_1    | 2017-11-11T18:28:08.398313Z 0 [Note] Executing 'SELECT * FROM INFORMATION_SCHEMA.TABLES;' to get a list of tables using the deprecated partition engine. You may use the startup option '--disable-partition-engine-check' to skip this check. 
db_1    | 2017-11-11T18:28:08.398331Z 0 [Note] Beginning of list of non-natively partitioned tables
sbds_1  | Nov 11 18:28:05 8d6e608cf7ab syslog-ng[16]: syslog-ng starting up; version='3.5.6'
sbds_1  | [1/6]   Confirm database connectivity...
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 176, "msecs": 748.2001781463623, "message": "configuring engine using mysql+mysqldb://user:***@db/sbds?charset=utf8mb4", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 18, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 183, "msecs": 752.7594566345215, "message": "configuring mysql backend", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 18, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 193, "msecs": 752.9926300048828, "message": "engine_kwargs: {'server_side_cursors': True, 'poolclass': <class 'sqlalchemy.pool.NullPool'>, 'encoding': 'utf8'}", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 18, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 176, "msecs": 769.8423862457275, "message": "configuring engine using mysql+mysqldb://user:***@db/sbds?charset=utf8mb4", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 14, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 183, "msecs": 770.4699039459229, "message": "configuring mysql backend", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 14, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 193, "msecs": 770.5895900726318, "message": "engine_kwargs: {'encoding': 'utf8', 'server_side_cursors': True}", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 14, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "ERROR", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "populate.py", "module": "populate", "funcName": "_populate", "lineno": 233, "msecs": 773.3011245727539, "message": "ERROR", "name": "sbds.storages.db.scripts.populate", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py", "process": 18, "processName": "MainProcess", "threadName": "MainThread", "exc_info": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py\", line 206, in _populate\n    task_confirm_db_connectivity(database_url, task_num=1)\n  File \"/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py\", line 77, in task_confirm_db_connectivity\n    raise Exception('Unable to connect to database')\nException: Unable to connect to database"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "jsonrpc.py", "module": "jsonrpc", "funcName": "register_method", "lineno": 124, "msecs": 779.1867256164551, "message": "registered method count_operations under namespace sbds as sbds.count_operations", "name": "uwsgi_file__app_sbds_server_serve", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/server/jsonrpc.py", "process": 14, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "jsonrpc.py", "module": "jsonrpc", "funcName": "register_method", "lineno": 124, "msecs": 780.428409576416, "message": "registered method get_custom_json_by_tid under namespace sbds as sbds.get_custom_json_by_tid", "name": "uwsgi_file__app_sbds_server_serve", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/server/jsonrpc.py", "process": 14, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "jsonrpc.py", "module": "jsonrpc", "funcName": "register_method", "lineno": 124, "msecs": 780.590295791626, "message": "registered method get_random_operation_block_nums under namespace sbds as sbds.get_random_operation_block_nums", "name": "uwsgi_file__app_sbds_server_serve", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/server/jsonrpc.py", "process": 14, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:08.1510424888GMT", "filename": "jsonrpc.py", "module": "jsonrpc", "funcName": "register_method", "lineno": 124, "msecs": 780.6892395019531, "message": "registered method get_random_operations under namespace sbds as sbds.get_random_operations", "name": "uwsgi_file__app_sbds_server_serve", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/server/jsonrpc.py", "process": 14, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x146a5d0 pid: 14 (default app)
sbds_1  | *** uWSGI is running in multiple interpreter mode ***
sbds_1  | spawned uWSGI master process (pid: 14)
sbds_1  | spawned uWSGI worker 1 (pid: 30, cores: 1)
sbds_1  | spawned uWSGI worker 2 (pid: 31, cores: 1)
sbds_1  | spawned uWSGI worker 3 (pid: 32, cores: 1)
sbds_1  | spawned uWSGI worker 4 (pid: 33, cores: 1)
sbds_1  | spawned uWSGI worker 5 (pid: 34, cores: 1)
sbds_1  | spawned uWSGI worker 6 (pid: 35, cores: 1)
sbds_1  | spawned uWSGI worker 7 (pid: 36, cores: 1)
sbds_1  | spawned uWSGI worker 8 (pid: 37, cores: 1)
sbds_1  | *** Stats server enabled on 0.0.0.0:9191 fd: 26 ***
db_1    | 2017-11-11T18:28:08.419466Z 0 [Note] End of list of non-natively partitioned tables
db_1    | Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it.
sbds_1  | spawned uWSGI http 1 (pid: 38)
sbds_1  | [1/6]   Confirm database connectivity...
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:11.1510424891GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 176, "msecs": 38.958072662353516, "message": "configuring engine using mysql+mysqldb://user:***@db/sbds?charset=utf8mb4", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 28, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:11.1510424891GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 183, "msecs": 39.77060317993164, "message": "configuring mysql backend", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 28, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:11.1510424891GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 193, "msecs": 39.90054130554199, "message": "engine_kwargs: {'server_side_cursors': True, 'encoding': 'utf8', 'poolclass': <class 'sqlalchemy.pool.NullPool'>}", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 28, "processName": "MainProcess", "threadName": "MainThread"}
db_1    | Warning: Unable to load '/usr/share/zoneinfo/leap-seconds.list' as time zone. Skipping it.
db_1    | Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it.
db_1    | 2017-11-11T18:28:11.786430Z 5 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.786579Z 5 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.786606Z 5 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.786616Z 5 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.786630Z 5 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.786659Z 5 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.786673Z 5 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | mysql: [Warning] Using a password on the command line interface can be insecure.
db_1    | mysql: [Warning] Using a password on the command line interface can be insecure.
db_1    | mysql: [Warning] Using a password on the command line interface can be insecure.
db_1    | mysql: [Warning] Using a password on the command line interface can be insecure.
db_1    | 2017-11-11T18:28:11.828250Z 9 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.828557Z 9 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.828606Z 9 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.828619Z 9 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.832221Z 9 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.832509Z 9 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:11.832532Z 9 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 
db_1    | 2017-11-11T18:28:11.836534Z 0 [Note] Giving 0 client threads a chance to die gracefully
db_1    | 2017-11-11T18:28:11.836694Z 0 [Note] Shutting down slave threads
db_1    | 2017-11-11T18:28:11.836713Z 0 [Note] Forcefully disconnecting 0 remaining clients
db_1    | 2017-11-11T18:28:11.836730Z 0 [Note] Event Scheduler: Purging the queue. 0 events
db_1    | 2017-11-11T18:28:11.836776Z 0 [Note] Binlog end
db_1    | 2017-11-11T18:28:11.837301Z 0 [Note] Shutting down plugin 'ngram'
db_1    | 2017-11-11T18:28:11.837320Z 0 [Note] Shutting down plugin 'BLACKHOLE'
db_1    | 2017-11-11T18:28:11.837330Z 0 [Note] Shutting down plugin 'partition'
db_1    | 2017-11-11T18:28:11.837337Z 0 [Note] Shutting down plugin 'ARCHIVE'
db_1    | 2017-11-11T18:28:11.837344Z 0 [Note] Shutting down plugin 'INNODB_SYS_VIRTUAL'
db_1    | 2017-11-11T18:28:11.837351Z 0 [Note] Shutting down plugin 'INNODB_SYS_DATAFILES'
db_1    | 2017-11-11T18:28:11.837358Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESPACES'
db_1    | 2017-11-11T18:28:11.837364Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN_COLS'
db_1    | 2017-11-11T18:28:11.837373Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN'
db_1    | 2017-11-11T18:28:11.837380Z 0 [Note] Shutting down plugin 'INNODB_SYS_FIELDS'
db_1    | 2017-11-11T18:28:11.837386Z 0 [Note] Shutting down plugin 'INNODB_SYS_COLUMNS'
db_1    | 2017-11-11T18:28:11.837393Z 0 [Note] Shutting down plugin 'INNODB_SYS_INDEXES'
db_1    | 2017-11-11T18:28:11.837399Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESTATS'
db_1    | 2017-11-11T18:28:11.837405Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLES'
db_1    | 2017-11-11T18:28:11.837412Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_TABLE'
db_1    | 2017-11-11T18:28:11.837418Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_CACHE'
db_1    | 2017-11-11T18:28:11.837424Z 0 [Note] Shutting down plugin 'INNODB_FT_CONFIG'
db_1    | 2017-11-11T18:28:11.837430Z 0 [Note] Shutting down plugin 'INNODB_FT_BEING_DELETED'
db_1    | 2017-11-11T18:28:11.837436Z 0 [Note] Shutting down plugin 'INNODB_FT_DELETED'
db_1    | 2017-11-11T18:28:11.837443Z 0 [Note] Shutting down plugin 'INNODB_FT_DEFAULT_STOPWORD'
db_1    | 2017-11-11T18:28:11.837449Z 0 [Note] Shutting down plugin 'INNODB_METRICS'
db_1    | 2017-11-11T18:28:11.837456Z 0 [Note] Shutting down plugin 'INNODB_TEMP_TABLE_INFO'
db_1    | 2017-11-11T18:28:11.837462Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_POOL_STATS'
db_1    | 2017-11-11T18:28:11.837469Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE_LRU'
db_1    | 2017-11-11T18:28:11.837475Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE'
db_1    | 2017-11-11T18:28:11.837481Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX_RESET'
db_1    | 2017-11-11T18:28:11.837487Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX'
db_1    | 2017-11-11T18:28:11.837494Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM_RESET'
db_1    | 2017-11-11T18:28:11.837500Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM'
db_1    | 2017-11-11T18:28:11.837506Z 0 [Note] Shutting down plugin 'INNODB_CMP_RESET'
db_1    | 2017-11-11T18:28:11.837512Z 0 [Note] Shutting down plugin 'INNODB_CMP'
db_1    | 2017-11-11T18:28:11.837519Z 0 [Note] Shutting down plugin 'INNODB_LOCK_WAITS'
db_1    | 2017-11-11T18:28:11.837525Z 0 [Note] Shutting down plugin 'INNODB_LOCKS'
db_1    | 2017-11-11T18:28:11.837531Z 0 [Note] Shutting down plugin 'INNODB_TRX'
db_1    | 2017-11-11T18:28:11.837537Z 0 [Note] Shutting down plugin 'InnoDB'
db_1    | 2017-11-11T18:28:11.837902Z 0 [Note] InnoDB: FTS optimize thread exiting.
db_1    | 2017-11-11T18:28:11.837945Z 0 [Note] InnoDB: Starting shutdown...
sbds_1  | {"levelname": "ERROR", "asctime": "2017-11-11T18:28:11.1510424891GMT", "filename": "populate.py", "module": "populate", "funcName": "_populate", "lineno": 233, "msecs": 55.65452575683594, "message": "ERROR", "name": "sbds.storages.db.scripts.populate", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py", "process": 28, "processName": "MainProcess", "threadName": "MainThread", "exc_info": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py\", line 206, in _populate\n    task_confirm_db_connectivity(database_url, task_num=1)\n  File \"/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py\", line 77, in task_confirm_db_connectivity\n    raise Exception('Unable to connect to database')\nException: Unable to connect to database"}
sbds_1  | [1/6]   Confirm database connectivity...
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:12.1510424892GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 176, "msecs": 663.6996269226074, "message": "configuring engine using mysql+mysqldb://user:***@db/sbds?charset=utf8mb4", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 42, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:12.1510424892GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 183, "msecs": 664.7803783416748, "message": "configuring mysql backend", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 42, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:12.1510424892GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 193, "msecs": 665.1406288146973, "message": "engine_kwargs: {'server_side_cursors': True, 'encoding': 'utf8', 'poolclass': <class 'sqlalchemy.pool.NullPool'>}", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 42, "processName": "MainProcess", "threadName": "MainThread"}
db_1    | 2017-11-11T18:28:11.938300Z 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
db_1    | 2017-11-11T18:28:11.938569Z 0 [Note] InnoDB: Buffer pool(s) dump completed at 171111 18:28:11
db_1    | 2017-11-11T18:28:13.156959Z 0 [Note] InnoDB: Shutdown completed; log sequence number 12169513
db_1    | 2017-11-11T18:28:13.158093Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
db_1    | 2017-11-11T18:28:13.161744Z 0 [Note] Shutting down plugin 'MRG_MYISAM'
db_1    | 2017-11-11T18:28:13.161791Z 0 [Note] Shutting down plugin 'MyISAM'
db_1    | 2017-11-11T18:28:13.161808Z 0 [Note] Shutting down plugin 'CSV'
db_1    | 2017-11-11T18:28:13.161819Z 0 [Note] Shutting down plugin 'MEMORY'
db_1    | 2017-11-11T18:28:13.161826Z 0 [Note] Shutting down plugin 'PERFORMANCE_SCHEMA'
db_1    | 2017-11-11T18:28:13.161847Z 0 [Note] Shutting down plugin 'sha256_password'
db_1    | 2017-11-11T18:28:13.161854Z 0 [Note] Shutting down plugin 'mysql_native_password'
db_1    | 2017-11-11T18:28:13.161956Z 0 [Note] Shutting down plugin 'binlog'
db_1    | 2017-11-11T18:28:13.162334Z 0 [Note] mysqld: Shutdown complete
db_1    | 
db_1    | 
db_1    | MySQL init process done. Ready for start up.
db_1    | 
db_1    | 2017-11-11T18:28:13.377534Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
db_1    | 2017-11-11T18:28:13.378374Z 0 [Note] mysqld (mysqld 5.7.20) starting as process 1 ...
db_1    | 2017-11-11T18:28:13.384838Z 0 [Note] InnoDB: PUNCH HOLE support available
db_1    | 2017-11-11T18:28:13.384896Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
db_1    | 2017-11-11T18:28:13.384908Z 0 [Note] InnoDB: Uses event mutexes
db_1    | 2017-11-11T18:28:13.384917Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
db_1    | 2017-11-11T18:28:13.384925Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
db_1    | 2017-11-11T18:28:13.384932Z 0 [Note] InnoDB: Using Linux native AIO
db_1    | 2017-11-11T18:28:13.385079Z 0 [Note] InnoDB: Number of pools: 1
db_1    | 2017-11-11T18:28:13.385150Z 0 [Note] InnoDB: Using CPU crc32 instructions
db_1    | 2017-11-11T18:28:13.386077Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
db_1    | 2017-11-11T18:28:13.393357Z 0 [Note] InnoDB: Completed initialization of buffer pool
db_1    | 2017-11-11T18:28:13.405317Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
db_1    | 2017-11-11T18:28:13.416641Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
db_1    | 2017-11-11T18:28:13.421784Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
db_1    | 2017-11-11T18:28:13.424209Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
db_1    | 2017-11-11T18:28:13.436595Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
db_1    | 2017-11-11T18:28:13.437183Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
db_1    | 2017-11-11T18:28:13.438014Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
db_1    | 2017-11-11T18:28:13.438395Z 0 [Note] InnoDB: Waiting for purge to start
db_1    | 2017-11-11T18:28:13.489115Z 0 [Note] InnoDB: 5.7.20 started; log sequence number 12169513
db_1    | 2017-11-11T18:28:13.490098Z 0 [Note] Plugin 'FEDERATED' is disabled.
db_1    | 2017-11-11T18:28:13.493204Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
db_1    | 2017-11-11T18:28:13.494371Z 0 [Warning] CA certificate ca.pem is self signed.
db_1    | 2017-11-11T18:28:13.494140Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
db_1    | 2017-11-11T18:28:13.505790Z 0 [Note] Server hostname (bind-address): '*'; port: 3306
db_1    | 2017-11-11T18:28:13.506003Z 0 [Note] IPv6 is available.
db_1    | 2017-11-11T18:28:13.506024Z 0 [Note]   - '::' resolves to '::';
db_1    | 2017-11-11T18:28:13.506045Z 0 [Note] Server socket created on IP: '::'.
db_1    | 2017-11-11T18:28:13.505975Z 0 [Note] InnoDB: Buffer pool(s) load completed at 171111 18:28:13
db_1    | 2017-11-11T18:28:13.508391Z 0 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:13.508472Z 0 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:13.508499Z 0 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:13.508508Z 0 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:13.508521Z 0 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:13.509695Z 0 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:13.509721Z 0 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
db_1    | 2017-11-11T18:28:13.512355Z 0 [Note] Event Scheduler: Loaded 0 events
db_1    | 2017-11-11T18:28:13.514333Z 0 [Note] mysqld: ready for connections.
db_1    | Version: '5.7.20'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  MySQL Community Server (GPL)
db_1    | 2017-11-11T18:28:13.515552Z 0 [Note] Executing 'SELECT * FROM INFORMATION_SCHEMA.TABLES;' to get a list of tables using the deprecated partition engine. You may use the startup option '--disable-partition-engine-check' to skip this check. 
db_1    | 2017-11-11T18:28:13.515618Z 0 [Note] Beginning of list of non-natively partitioned tables
sbds_1  | {"levelname": "ERROR", "asctime": "2017-11-11T18:28:12.1510424892GMT", "filename": "populate.py", "module": "populate", "funcName": "_populate", "lineno": 233, "msecs": 683.1343173980713, "message": "ERROR", "name": "sbds.storages.db.scripts.populate", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py", "process": 42, "processName": "MainProcess", "threadName": "MainThread", "exc_info": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py\", line 206, in _populate\n    task_confirm_db_connectivity(database_url, task_num=1)\n  File \"/usr/local/lib/python3.5/dist-packages/sbds/storages/db/scripts/populate.py\", line 77, in task_confirm_db_connectivity\n    raise Exception('Unable to connect to database')\nException: Unable to connect to database"}
sbds_1  | [1/6]   Confirm database connectivity...
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:14.1510424894GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 176, "msecs": 47.56736755371094, "message": "configuring engine using mysql+mysqldb://user:***@db/sbds?charset=utf8mb4", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:14.1510424894GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 183, "msecs": 48.08759689331055, "message": "configuring mysql backend", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:14.1510424894GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 193, "msecs": 48.20704460144043, "message": "engine_kwargs: {'server_side_cursors': True, 'encoding': 'utf8', 'poolclass': <class 'sqlalchemy.pool.NullPool'>}", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | success connected to mysql+mysqldb://user:***@db/sbds?charset=utf8mb4 and found 0 tables
sbds_1  | [2/6]   Initialising db if required...
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:14.1510424894GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 176, "msecs": 74.31745529174805, "message": "configuring engine using mysql+mysqldb://user:***@db/sbds?charset=utf8mb4", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:14.1510424894GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 183, "msecs": 74.51534271240234, "message": "configuring mysql backend", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:14.1510424894GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 193, "msecs": 74.69463348388672, "message": "engine_kwargs: {'server_side_cursors': True, 'encoding': 'utf8', 'poolclass': <class 'sqlalchemy.pool.NullPool'>}", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | [3/6]   Finding highest blockchain block...
sbds_1  | [4/6]   Finding blocks missing from db...
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:16.1510424896GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 176, "msecs": 377.4142265319824, "message": "configuring engine using mysql+mysqldb://user:***@db/sbds?charset=utf8mb4", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:16.1510424896GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 183, "msecs": 377.63285636901855, "message": "configuring mysql backend", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | {"levelname": "DEBUG", "asctime": "2017-11-11T18:28:16.1510424896GMT", "filename": "utils.py", "module": "utils", "funcName": "configure_engine", "lineno": 193, "msecs": 377.73776054382324, "message": "engine_kwargs: {'server_side_cursors': True, 'encoding': 'utf8'}", "name": "sbds.storages.db.utils", "pathname": "/usr/local/lib/python3.5/dist-packages/sbds/storages/db/utils.py", "process": 47, "processName": "MainProcess", "threadName": "MainThread"}
sbds_1  | Finding missing block_nums
sbds_1  | success found 17135487 missing blocks

...then hang. this is with logging set to DEBUG. the real bug is that it's not logging why it's not synchronizing, the secondary bug is the hang.

sneak commented 6 years ago

@john-g-g ?

sneak commented 6 years ago

seems to work now with the docker-compose from #82