Migration dont work

[MaratIR]

I installed elastic and redis on a virtual machine on disk, ran api, gui and worker 0.8.1 through docker like this:

docker run -d --name tracardi-api -p 8686:80 -e ELASTIC_HOST=http://10.0.2.15:9200 -e REDIS_HOST=redis://10.0.2.15:6379 tracardi/tracardi-api:0.8.1 docker run -d --name tracardi-gui -p 8787:80 -e ELASTIC_HOST=http://10.0.2.15:9200 -e REDIS_HOST=redis://10.0.2.15:6379 tracardi/tracardi-gui:0.8.1 docker run -d --name worker -e REDIS_HOST=redis://10.0.2.15:6379 tracardi/update-worker:0.8.1

Then similarly ran the tracardi version also all three services 0.8.2-rc2.

docker run -d --name tracardi-api1 -p 8688:80 -e ELASTIC_HOST=http://10.0.2.15:9200 -e REDIS_HOST=redis://10.0.2.15:6379 tracardi/tracardi-api:0.8.2-rc2 docker run -d --name tracardi-gui1 -p 8788:80 -e ELASTIC_HOST=http://10.0.2.15:9200 -e REDIS_HOST=redis://10.0.2.15:6379 tracardi/tracardi-gui:0.8.2-rc2 docker run -d --name worker1 -e REDIS_HOST=redis://10.0.2.15:6379 tracardi/update-worker:0.8.2-rc2

After I start the migration engine nothing happens. Tried doing this with containers 0.8.1 disabled and enabled. Also tried doing this by changing the environment from production to test and back again. Nothing happens.

[atompie]

@MaratIR Please make sure that the migration worker is executed. http://docs.tracardi.com/installation/workers/install_update_worker/

If it still does not work please the the worker logs and pate it here.

[MaratIR]

vagrant@ubuntu-focal:/tmp/cdp$ docker logs 6ed0de4396b0

 -------------- celery@6ed0de4396b0 v5.2.6 (dawn-chorus)
--- ***** -----
-- ******* ---- Linux-5.4.0-167-generic-x86_64-with-glibc2.36 2023-12-04 07:28:47
- *** --- * ---
- ** ---------- [config]
- ** ---------- .> app:         tracardi.worker.celery_worker:0x7f736404e9e0
- ** ---------- .> transport:   redis://10.0.2.15:6379//
- ** ---------- .> results:     redis://10.0.2.15:6379/
- *** --- * --- .> concurrency: 2 (prefork)
-- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
--- ***** -----
 -------------- [queues]
                .> celery           exchange=celery(direct) key=celery

[tasks]
  . tracardi.worker.celery_worker.run_elastic_import_job
  . tracardi.worker.celery_worker.run_migration_job
  . tracardi.worker.celery_worker.run_migration_worker
  . tracardi.worker.celery_worker.run_mysql_import_job
  . tracardi.worker.celery_worker.run_mysql_query_import_job

[2023-12-04 07:28:47,430: INFO/MainProcess] Connected to redis://10.0.2.15:6379//
[2023-12-04 07:28:47,432: INFO/MainProcess] mingle: searching for neighbors
[2023-12-04 07:28:48,441: INFO/MainProcess] mingle: all alone
[2023-12-04 07:28:48,452: INFO/MainProcess] celery@6ed0de4396b0 ready.
[2023-12-04 07:36:00,006: INFO/MainProcess] sync with celery@ff5959a2840e
[2023-12-04 07:36:58,611: INFO/MainProcess] missed heartbeat from celery@ff5959a2840e
[2023-12-04 07:40:04,597: INFO/MainProcess] sync with celery@4931df7e8d39

yes it still doesn't work, neither with worker 0.8.1 nor with 0.8.2-rc2

[MaratIR]

vagrant@ubuntu-focal:/tmp/cdp$ docker logs 4931df7e8d39

 -------------- celery@4931df7e8d39 v5.2.6 (dawn-chorus)
--- ***** -----
-- ******* ---- Linux-5.4.0-167-generic-x86_64-with-glibc2.36 2023-12-04 07:40:04
- *** --- * ---
- ** ---------- [config]
- ** ---------- .> app:         tracardi.worker.celery_worker:0x7f56d220e9e0
- ** ---------- .> transport:   redis://10.0.2.15:6379//
- ** ---------- .> results:     redis://10.0.2.15:6379/
- *** --- * --- .> concurrency: 2 (prefork)
-- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
--- ***** -----
 -------------- [queues]
                .> celery           exchange=celery(direct) key=celery

[tasks]
  . tracardi.worker.celery_worker.run_elastic_import_job
  . tracardi.worker.celery_worker.run_migration_job
  . tracardi.worker.celery_worker.run_migration_worker
  . tracardi.worker.celery_worker.run_mysql_import_job
  . tracardi.worker.celery_worker.run_mysql_query_import_job

[2023-12-04 07:40:04,587: INFO/MainProcess] Connected to redis://10.0.2.15:6379//
[2023-12-04 07:40:04,590: INFO/MainProcess] mingle: searching for neighbors
[2023-12-04 07:40:05,601: INFO/MainProcess] mingle: sync with 1 nodes
[2023-12-04 07:40:05,602: INFO/MainProcess] mingle: sync complete
[2023-12-04 07:40:05,616: INFO/MainProcess] celery@4931df7e8d39 ready.

worker: Warm shutdown (MainProcess)

 -------------- celery@4931df7e8d39 v5.2.6 (dawn-chorus)
--- ***** -----
-- ******* ---- Linux-5.4.0-167-generic-x86_64-with-glibc2.36 2023-12-04 07:48:27
- *** --- * ---
- ** ---------- [config]
- ** ---------- .> app:         tracardi.worker.celery_worker:0x7fa56da9c940
- ** ---------- .> transport:   redis://10.0.2.15:6379//
- ** ---------- .> results:     redis://10.0.2.15:6379/
- *** --- * --- .> concurrency: 2 (prefork)
-- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
--- ***** -----
 -------------- [queues]
                .> celery           exchange=celery(direct) key=celery

[tasks]
  . tracardi.worker.celery_worker.run_elastic_import_job
  . tracardi.worker.celery_worker.run_migration_job
  . tracardi.worker.celery_worker.run_migration_worker
  . tracardi.worker.celery_worker.run_mysql_import_job
  . tracardi.worker.celery_worker.run_mysql_query_import_job

[2023-12-04 07:48:27,518: INFO/MainProcess] Connected to redis://10.0.2.15:6379//
[2023-12-04 07:48:27,522: INFO/MainProcess] mingle: searching for neighbors
[2023-12-04 07:48:28,532: INFO/MainProcess] mingle: sync with 1 nodes
[2023-12-04 07:48:28,532: INFO/MainProcess] mingle: sync complete
[2023-12-04 07:48:28,542: INFO/MainProcess] celery@4931df7e8d39 ready.

[MaratIR]

Fixed with updating docker images.