search

eikek / docspell

Assist in organizing your piles of documents, resulting from scanners, e-mails and other sources with miminal effort.
https://docspell.org
GNU Affero General Public License v3.0
1.59k stars 120 forks source link

Joex fails to start: SQL processing failed #2661

Open daviddavo opened 4 months ago

daviddavo commented 4 months ago

The rest server works fine, but I can't run joex because I get the following error:

docspell_joex.1.y178r29q95im@suisei    | ***>  ______                          _ _
docspell_joex.1.y178r29q95im@suisei    | ***>  |  _  \                        | | |
docspell_joex.1.y178r29q95im@suisei    | ***>  | | | |___   ___ ___ _ __   ___| | |
docspell_joex.1.y178r29q95im@suisei    | ***>  | | | / _ \ / __/ __| '_ \ / _ \ | |
docspell_joex.1.y178r29q95im@suisei    | ***>  | |/ / (_) | (__\__ \ |_) |  __/ | |
docspell_joex.1.y178r29q95im@suisei    | ***>  |___/ \___/ \___|___/ .__/ \___|_|_|
docspell_joex.1.y178r29q95im@suisei    | ***>                      | |
docspell_joex.1.y178r29q95im@suisei    | ***>                      |_| v0.41.0 (#50dadad4)
docspell_joex.1.y178r29q95im@suisei    | ***>  << JOEX >>
docspell_joex.1.y178r29q95im@suisei    | ***>  Id:       joex-suisei
docspell_joex.1.y178r29q95im@suisei    | ***>  Base-Url: http://docspell-joex:7878
docspell_joex.1.y178r29q95im@suisei    | ***>  Database: jdbc:postgresql://docspell_db:5432/dbname
docspell_joex.1.y178r29q95im@suisei    | ***>  Fts:      Solr(http://solr:8983/solr/docspell)
docspell_joex.1.y178r29q95im@suisei    | ***>  Config:
docspell_joex.1.y178r29q95im@suisei    | ***>  FileRepo: DefaultDatabase(true)
docspell_joex.1.y178r29q95im@suisei    | ***>
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:24:0001 [io-comp...] [INFO ] docspell.store.migrate.FlywayMigrate.createFlyway:34 - Creating Flyway for: List(classpath:db/fixups/postgresql, classpath:db/fixups/common)
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0000 [io-comp...] [INFO ] docspell.store.migrate.FlywayMigrate.runFixups:79 - !!! Running fixup migrations (repair=false)
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0001 [io-comp...] [INFO ] org.flywaydb.core.FlywayExecutor - Database: jdbc:postgresql://docspell_db:5432/dbname (PostgreSQL 16.2)
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0002 [io-comp...] [INFO ] org.flywaydb.core.internal.command.DbValidate - Successfully validated 2 migrations (execution time 00:00.068s)
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0003 [io-comp...] [INFO ] org.flywaydb.core.internal.command.DbMigrate - Current version of schema "public": 1.33.0
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0004 [io-comp...] [INFO ] org.flywaydb.core.internal.command.DbMigrate - Schema "public" is up to date. No migration necessary.
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0005 [io-comp...] [INFO ] docspell.store.migrate.FlywayMigrate.createFlyway:34 - Creating Flyway for: List(classpath:db/migration/postgresql, classpath:db/migration/common)
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0006 [io-comp...] [INFO ] docspell.store.migrate.FlywayMigrate.runMain:59 - !!! Running main migrations (repair=false)
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0007 [io-comp...] [INFO ] org.flywaydb.core.FlywayExecutor - Database: jdbc:postgresql://docspell_db:5432/dbname (PostgreSQL 16.2)
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0008 [io-comp...] [INFO ] org.flywaydb.core.internal.command.DbValidate - Successfully validated 68 migrations (execution time 00:00.092s)
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0009 [io-comp...] [INFO ] org.flywaydb.core.internal.command.DbMigrate - Current version of schema "public": 1.39.3
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:25:0010 [io-comp...] [INFO ] org.flywaydb.core.internal.command.DbMigrate - Schema "public" is up to date. No migration necessary.
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:27:0000 [io-comp...] [INFO ] docspell.analysis.nlp.PipelineCache.create:129 - Clearing StanfordNLP cache after Duration(900000ms) idle time
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:27:0001 [io-comp...] [INFO ] docspell.analysis.nlp.PipelineCache.apply:44 - Creating nlp pipeline cache
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:27:0002 [io-comp...] [INFO ] docspell.backend.ops.ONode.register:52 - Registering node joex-suisei
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:27:0003 [io-comp...] [ERROR] docspell.store.impl.DoobieLogging.run:27 - SQL processing failed: SELECT job.jid, job.task, job.group_, job.args, job.subject, job.submitted, job.submitter, job.priority, job.state, job.retries, job.progress, job.tracker, job.worker, job.started, job.finished FROM job  WHERE (job.tracker = ?  AND job.state IN (? , ? , ? , ? )) (List(Ident(all-page-count-tracker), Waiting, Scheduled, Running, Stuck))
docspell_joex.1.y178r29q95im@suisei    | doobie.util.invariant$UnexpectedContinuation$: Expected ResultSet exhaustion, but more rows were available.
docspell_joex.1.y178r29q95im@suisei    |    at doobie.util.invariant$UnexpectedContinuation$.<clinit>(invariant.scala:25)
docspell_joex.1.y178r29q95im@suisei    |    at doobie.hi.resultset$.$anonfun$getOption$1(resultset.scala:218)
docspell_joex.1.y178r29q95im@suisei    |    at cats.free.Free.step(Free.scala:77)
docspell_joex.1.y178r29q95im@suisei    |    at cats.free.Free.$anonfun$foldMap$1(Free.scala:164)
docspell_joex.1.y178r29q95im@suisei    |    at cats.data.KleisliFlatMap.$anonfun$tailRecM$2(Kleisli.scala:701)
docspell_joex.1.y178r29q95im@suisei    |    at cats.StackSafeMonad.tailRecM(StackSafeMonad.scala:37)
docspell_joex.1.y178r29q95im@suisei    |    at cats.StackSafeMonad.tailRecM$(StackSafeMonad.scala:36)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |
docspell_joex.1.y178r29q95im@suisei    | 2024.05.27 20:45:27:0004 [io-comp...] [INFO ] docspell.backend.ops.ONode.unregister:57 - Unregister app joex-suisei
docspell_joex.1.y178r29q95im@suisei    | doobie.util.invariant$UnexpectedContinuation$: Expected ResultSet exhaustion, but more rows were available.
docspell_joex.1.y178r29q95im@suisei    |    at doobie.util.invariant$UnexpectedContinuation$.<clinit>(invariant.scala:25)
docspell_joex.1.y178r29q95im@suisei    |    at doobie.hi.resultset$.$anonfun$getOption$1(resultset.scala:218)
docspell_joex.1.y178r29q95im@suisei    |    at cats.free.Free.step(Free.scala:77)
docspell_joex.1.y178r29q95im@suisei    |    at cats.free.Free.$anonfun$foldMap$1(Free.scala:164)
docspell_joex.1.y178r29q95im@suisei    |    at cats.data.KleisliFlatMap.$anonfun$tailRecM$2(Kleisli.scala:701)
docspell_joex.1.y178r29q95im@suisei    |    at cats.StackSafeMonad.tailRecM(StackSafeMonad.scala:37)
docspell_joex.1.y178r29q95im@suisei    |    at cats.StackSafeMonad.tailRecM$(StackSafeMonad.scala:36)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
docspell_joex.1.y178r29q95im@suisei    |    at $anonfun$tailRecM$1 @ doobie.util.transactor$Transactor$$anon$4.$anonfun$apply$4(transactor.scala:165)
docspell_joex.1.y178r29q95im@suisei    |    at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)

The rest server is also on the same version (v0.41.0). I've never used the nightly, so this is not a duplicate of #1642

Note: I have two instances of joex running, both behind a balancer and the URL http://docspell-joex:7878, but with different IDs

eikek commented 4 months ago

Hi @daviddavo

can you perhaps run this sql and show me the results:

-- Ident(all-page-count-tracker), Waiting, Scheduled, Running, Stuck
SELECT job.jid, job.task, job.group_, job.args, job.subject, job.submitted, job.submitter, job.priority, job.state, job.retries, job.progress, job.tracker, job.worker, job.started, job.finished
FROM job
WHERE (job.tracker = 'all-page-count-tracker'  AND job.state IN ('Waiting' , 'Scheduled' , 'Running' , 'Stuck'))

(this is taken from your log output, replacing the ? with the data at the end of line). Looking at the sql it seems to be a bug when selecting unfinished jobs. :/

daviddavo commented 4 months ago

I get no results:

root@b04185264929:/# psql -d dbname -f "query.sql" -U dbuser
 jid | task | group_ | args | subject | submitted | submitter | priority | state | retries | progress | tracker | worker | started | finished
-----+------+--------+------+---------+-----------+-----------+----------+-------+---------+----------+---------+--------+---------+----------
(0 rows)

root@b04185264929:/# psql -d dbname -U dbuser -c 'select COUNT(*) from pg_stat_activity'
 count
-------
    47
(1 row)
daviddavo commented 4 months ago

I tried changing the query a bit:

-- Ident(all-page-count-tracker), Waiting, Scheduled, Running, Stuck
SELECT job.jid, job.task, job.group_, job.args, job.subject, job.submitted, job.submitter, job.priority, job.state, job.retries, job.progress, job.tracker, job.worker, job.started, job.finished
FROM job
WHERE (job.state != 'success')
$ psql -d dbname -f "coso.sql" -U dbuser
                       jid                       |      task       |     group_      |                                                                                                                                                                                                                    args                                                                                                                                                                                                                     |                     subject                     |         submitted          |    submitter    | priority |  state  | retries | progress |                     tracker                     |   worker    |          started           |          finished
-------------------------------------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------+----------------------------+-----------------+----------+---------+---------+----------+-------------------------------------------------+-------------+----------------------------+----------------------------
 76MWnvhtsNV-CvLt1prYZJW-r5YcqbxyV29-TQXWSmBJJp4 | process-item    | 1               | {"meta":{"collective":1,"itemId":null,"language":"deu","direction":null,"sourceAbbrev":"integration","folderId":null,"validFileTypes":[],"skipDuplicate":true,"fileFilter":"*","tags":[],"reprocess":false,"attachmentsOnly":false,"customData":null},"files":[{"name":"cae_big.pdf","fileMetaId":{"collective":1,"category":"attachmentsource","id":"5feDvDvYsdEnUuT7FNbt5oGnXpCPDRCEdkCgfNymL23H"}}]}                                     | cae_big.pdf                                     | 2024-03-27 12:26:36.080979 | 1               |        0 | running |       0 |       20 | CqbJ5GFdbTC-xvPxt71tH5P-VmwmYvrDrFE-iP7GN9FjiY8 | joex1       | 2024-03-27 12:48:21.362335 |
 CEcqbkUEYk6-4KtpDZd76kX-UCFuUvsDfRm-CySU1KFyaJa | full-text-index | docspell-system | {}                                                                                                                                                                                                                                                                                                                                                                                                                                          | Create full-text index                          | 2024-03-27 20:31:25.970866 | docspell-system |        0 | stuck   |      17 |        0 | full-text-index-tracker                         | joex-aerial | 2024-03-27 20:31:26.451285 | 2024-03-27 20:31:27.023648
 Av381YzRMry-8hk7FHCKbEK-JYtixKq4uUK-5sZ6KFW3TZ7 | process-item    | 1               | {"meta":{"collective":1,"itemId":null,"language":"spa","direction":null,"sourceAbbrev":"integration","folderId":null,"validFileTypes":[],"skipDuplicate":true,"fileFilter":"*","tags":[],"reprocess":false,"attachmentsOnly":false,"customData":null},"files":[{"name":"es.aeat.dit.adu.eeca.catalogo.vis.Visualiza.pdf","fileMetaId":{"collective":1,"category":"attachmentsource","id":"3mLWVyNZ8ZFtoBHzinUNC6koVTy7bRaQBpCnnkJ5y7eN"}}]} | es.aeat.dit.adu.eeca.catalogo.vis.Visualiza.pdf | 2024-05-11 17:23:22.868502 | 1               |        0 | waiting |       0 |       40 | 6bW9ZVUwtjY-7kt8Sx2CUvP-K6esRCBfNHk-y3rvXo9FeyP | joex-suisei | 2024-05-16 21:55:55.548283 |
 9DbaJHKM9mD-uujf8NJEY2P-a9JVzLR4XQN-BkZLL69FdHh | all-previews    | docspell-system | {"collective":null,"storeMode":"whenmissing"}                                                                                                                                                                                                                                                                                                                                                                                               | Create preview images                           | 2024-05-16 21:55:54.811381 | docspell-system |        0 | waiting |       0 |        0 | generate-all-previews                           |             |                            |
 HmifruTDUbk-ZT9eLaQmVWi-d37ayV24UJZ-moy6qV2ARdc | all-page-count  | docspell-system | {}                                                                                                                                                                                                                                                                                                                                                                                                                                          | Create all page-counts                          | 2024-05-16 21:55:54.859923 | docspell-system |        0 | waiting |       0 |        0 | all-page-count-tracker                          |             |                            |
 Awhx2edUahK-Q2PvwpXrKXa-omXPLqr9WcG-kwDEDRyTFuJ | all-page-count  | docspell-system | {}                                                                                                                                                                                                                                                                                                                                                                                                                                          | Create all page-counts                          | 2024-05-16 21:55:54.864825 | docspell-system |        0 | waiting |       0 |        0 | all-page-count-tracker                          |             |                            |
 CUAc5PCv57A-UMx2FvQmsxn-wcpAWBGN93V-LmNuZbySm4r | process-item    | 1               | {"meta":{"collective":1,"itemId":null,"language":"spa","direction":null,"sourceAbbrev":"integration","folderId":null,"validFileTypes":[],"skipDuplicate":true,"fileFilter":"*","tags":[],"reprocess":false,"attachmentsOnly":false,"customData":null},"files":[{"name":"2024_csim_japonés_certificado.pdf","fileMetaId":{"collective":1,"category":"attachmentsource","id":"9j2Qite9XsqDw8udgHcpxQa2EDn2gonfVGsp8gkw8Sgm"}}]}               | 2024_csim_japonés_certificado.pdf               | 2024-05-20 13:59:19.362341 | 1               |        0 | waiting |       0 |        0 | J2oXTbECT5Y-yoLNQWLxALD-bC6UCQVBk1Q-nN84UjdaeP8 |             |                            |
(7 rows)

It seems that jobs have the status with lowercase letters instead of uppercase

eikek commented 4 months ago

Can you try removing one of the all-page-count jobs? Just pick one. Either HmifruTDUbk-ZT9eLaQmVWi-d37ayV24UJZ-moy6qV2ARdc or Awhx2edUahK-Q2PvwpXrKXa-omXPLqr9WcG-kwDEDRyTFuJ

daviddavo commented 4 months ago

How can I export de original file first? It was directly sent to docspell from the scanner.

And what command should I use to delete it?

daviddavo commented 4 months ago

Figured it out:

DELETE
FROM job
WHERE (job.jid = 'HmifruTDUbk-ZT9eLaQmVWi-d37ayV24UJZ-moy6qV2ARdc')
-- DELETE 1

New state:

                       jid                       |      task       |     group_      |                                                                                                                                                                                                                    args                                                                                                                                                                                                                     |                     subject                     |         submitted          |    submitter    | priority |  state  | retries | progress |                     tracker                     |   worker    |          started           |          finished
-------------------------------------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------+----------------------------+-----------------+----------+---------+---------+----------+-------------------------------------------------+-------------+----------------------------+----------------------------
 76MWnvhtsNV-CvLt1prYZJW-r5YcqbxyV29-TQXWSmBJJp4 | process-item    | 1               | {"meta":{"collective":1,"itemId":null,"language":"deu","direction":null,"sourceAbbrev":"integration","folderId":null,"validFileTypes":[],"skipDuplicate":true,"fileFilter":"*","tags":[],"reprocess":false,"attachmentsOnly":false,"customData":null},"files":[{"name":"cae_big.pdf","fileMetaId":{"collective":1,"category":"attachmentsource","id":"5feDvDvYsdEnUuT7FNbt5oGnXpCPDRCEdkCgfNymL23H"}}]}                                     | cae_big.pdf                                     | 2024-03-27 12:26:36.080979 | 1               |        0 | running |       0 |       20 | CqbJ5GFdbTC-xvPxt71tH5P-VmwmYvrDrFE-iP7GN9FjiY8 | joex1       | 2024-03-27 12:48:21.362335 |
 CEcqbkUEYk6-4KtpDZd76kX-UCFuUvsDfRm-CySU1KFyaJa | full-text-index | docspell-system | {}                                                                                                                                                                                                                                                                                                                                                                                                                                          | Create full-text index                          | 2024-03-27 20:31:25.970866 | docspell-system |        0 | stuck   |      17 |        0 | full-text-index-tracker                         | joex-aerial | 2024-03-27 20:31:26.451285 | 2024-03-27 20:31:27.023648
 Awhx2edUahK-Q2PvwpXrKXa-omXPLqr9WcG-kwDEDRyTFuJ | all-page-count  | docspell-system | {}                                                                                                                                                                                                                                                                                                                                                                                                                                          | Create all page-counts                          | 2024-05-16 21:55:54.864825 | docspell-system |        0 | waiting |       0 |        0 | all-page-count-tracker                          |             |                            |
 CUAc5PCv57A-UMx2FvQmsxn-wcpAWBGN93V-LmNuZbySm4r | process-item    | 1               | {"meta":{"collective":1,"itemId":null,"language":"spa","direction":null,"sourceAbbrev":"integration","folderId":null,"validFileTypes":[],"skipDuplicate":true,"fileFilter":"*","tags":[],"reprocess":false,"attachmentsOnly":false,"customData":null},"files":[{"name":"2024_csim_japonés_certificado.pdf","fileMetaId":{"collective":1,"category":"attachmentsource","id":"9j2Qite9XsqDw8udgHcpxQa2EDn2gonfVGsp8gkw8Sgm"}}]}               | 2024_csim_japonés_certificado.pdf               | 2024-05-20 13:59:19.362341 | 1               |        0 | waiting |       0 |        0 | J2oXTbECT5Y-yoLNQWLxALD-bC6UCQVBk1Q-nN84UjdaeP8 |             |                            |
 9CEoMzSugib-NNbD5Pa7Wfh-cAibK6YJR2Z-BZdTDuoyMzz | process-item    | 1               | {"meta":{"collective":1,"itemId":null,"language":"spa","direction":null,"sourceAbbrev":"integration","folderId":null,"validFileTypes":[],"skipDuplicate":true,"fileFilter":"*","tags":[],"reprocess":false,"attachmentsOnly":false,"customData":null},"files":[{"name":"justificante.pdf","fileMetaId":{"collective":1,"category":"attachmentsource","id":"HJZAZFWAZVjiaNFsGZXHttoTJus2XdB37upjbX5wfdnS"}}]}                                | justificante.pdf                                | 2024-05-28 20:18:47.138084 | 1               |        0 | waiting |       0 |        0 | GoHAq2v2SWb-CFhtQKBaVS2-Ed2524Xt5HN-a2zLzDjM6hP |             |                            |
 Av381YzRMry-8hk7FHCKbEK-JYtixKq4uUK-5sZ6KFW3TZ7 | process-item    | 1               | {"meta":{"collective":1,"itemId":null,"language":"spa","direction":null,"sourceAbbrev":"integration","folderId":null,"validFileTypes":[],"skipDuplicate":true,"fileFilter":"*","tags":[],"reprocess":false,"attachmentsOnly":false,"customData":null},"files":[{"name":"es.aeat.dit.adu.eeca.catalogo.vis.Visualiza.pdf","fileMetaId":{"collective":1,"category":"attachmentsource","id":"3mLWVyNZ8ZFtoBHzinUNC6koVTy7bRaQBpCnnkJ5y7eN"}}]} | es.aeat.dit.adu.eeca.catalogo.vis.Visualiza.pdf | 2024-05-11 17:23:22.868502 | 1               |        0 | running |       0 |       40 | 6bW9ZVUwtjY-7kt8Sx2CUvP-K6esRCBfNHk-y3rvXo9FeyP | joex-suisei | 2024-05-29 17:49:58.631804 |
(6 rows)

It seems to be working now, thanks!

But I don't know what might have caused the problem. Perhaps the fact that I have multiple joex instances under a single url?

eikek commented 4 months ago

Hey, sorry for the late reply. Yes, that is the command I meant. This job is not about processing files, so you don't need to save it somewhere first. And yes, the question is why it was inserted twice. I think it is due to the two instances starting up at the same time, there seems to be no guarding here (all just a guess, haven't had the time yet to really take a look). Both entries have been inserted only a fraction of a second apart. I'll create another issue to take a deeper look