search

StrangeBeeCorp / TheHive-feedback

TheHive 5 feedback repository
https://www.strangebee.com/thehive
5 stars 0 forks source link

[Bug] UI doesn't display list of cases and alerts after migrating from v4.1.21 (Docker) #10

Closed b3belov closed 2 years ago

b3belov commented 2 years ago

Hello all!

I observed following issue after migration to v5.0.9 from v4.2.21: image

My migration path:

  1. Replace TheHive docker image version in docker-compose
  2. Add elastic container config to docker-compose
  3. Add following lines to application.conf db.janusgraph.index.search.elasticsearch.bulk-refresh = false db.janusgraph.forceDropAndRebuildIndex = true and change config for indexes
  4. Start docker-compose
  5. Wait for reindex

When I try to load list of cases/alerts they are not displayed in UI, though overall amount displayed right. Also I found following logs in application.log, according to timeline log occurred when I tried to open cases list: [error] o.t.s.m.UMapping$long [e0ad47c1327b760a|93682401bc638976] Case 422441024 doesn't comply with its schema, field timeToDetect is missing:

vdebergue commented 2 years ago

Hello,

Could you tell what is the reported schema version of the application ? You can get this info in the Admin Panel > Platform Management > Status

image

It seems from your logs that a schema migration was not applied correctly. But to be sure, could you also provide more logs when this error happens ?

b3belov commented 2 years ago

image

b3belov commented 2 years ago

Logs generated when i tried to list alerts:

[info] o.t.s.AccessLogFilter [412d3455289161d3|b43cb0f58d4cdd4c] 172.19.0.5 POST /api/v1/query?name=get-case-templates took 61ms and returned 200
[info] o.t.s.AccessLogFilter [34f3e89e83ac09a0|cda0cd9645907c71] 172.19.0.5 POST /api/v1/query?name=get-organisation-Playtech took 6ms and returned 200
[info] o.t.s.AccessLogFilter [fe20920531924e14|394f76731d5723ca] 172.19.0.5 POST /api/stream took 3ms and returned 200 20 bytes
[info] o.t.s.AccessLogFilter [d5c985e51a24395c|918affccef0c35a7] 172.19.0.5 POST /api/v1/query?name=get-all-case-status took 9ms and returned 200
[info] o.t.s.AccessLogFilter [619ef7c6fe26be19|27b3ccdd0e292ef5] 172.19.0.5 POST /api/v1/chart/category took 16ms and returned 200
[info] o.t.s.AccessLogFilter [02d19f5a27fed10f|68643ba9c2d6c909] 172.19.0.5 POST /api/v1/chart/category took 17ms and returned 200
[info] o.t.s.AccessLogFilter [ac75c8b13c2521d9|32dfaa6a09aa16d7] 172.19.0.5 POST /api/v1/chart/category took 13ms and returned 200
[info] o.t.s.AccessLogFilter [a4bcdd888ce4f5a8|6280b2cec0f83b1b] 172.19.0.5 POST /api/v1/query?name=get-all-cases took 322ms and returned 200
[info] o.t.s.AccessLogFilter [295ea6d9c08e2ae1|4ac56f5aefa4fece] 172.19.0.5 POST /api/v1/query?name=count-get-all-cases took 390ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [8ed8c42b3fe5ebf5|14c2a6626c801d27] 172.19.0.5 POST /api/v1/query?name=count-all-get-all-cases took 356ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [9a027bf6be55bd2e|fc42de6dce38a3c3] 172.19.0.5 POST /api/stream took 2ms and returned 200 20 bytes
[info] o.t.s.AccessLogFilter [d39feb69374cac0c|67d95006f8d9bae3] 172.19.0.5 POST /api/v1/query?name=get-Playtech-users took 54ms and returned 200
[info] o.t.s.AccessLogFilter [d233c1f30e1e364e|ca0649869d7ae8f6] 172.19.0.5 POST /api/v1/query?name=count-new-alerts took 100ms and returned 200 1 bytes
[error] o.t.s.m.UMapping$string [d39feb69374cac0c|67d95006f8d9bae3] vertex 24584 doesn't comply with its schema, field login is missing:
v[24584]
[error] o.t.s.m.UMapping$string [d39feb69374cac0c|67d95006f8d9bae3] vertex 24584 doesn't comply with its schema, field name is missing:
v[24584]
[error] o.t.s.m.UMapping$boolean [d39feb69374cac0c|67d95006f8d9bae3] vertex 24584 doesn't comply with its schema, field locked is missing:
v[24584]
[error] o.t.s.m.SingleMapping [d39feb69374cac0c|67d95006f8d9bae3] vertex 24584 doesn't comply with its schema, field type is missing:
v[24584]
[error] o.t.s.traversal [d39feb69374cac0c|67d95006f8d9bae3] Traversal has generated an error
java.util.NoSuchElementException:  is not a member of Enum (Normal, Service)
        at enumeratum.Enum.$anonfun$withNameInsensitive$1(Enum.scala:111)
        at scala.Option.getOrElse(Option.scala:201)
        at enumeratum.Enum.withNameInsensitive(Enum.scala:111)
        at enumeratum.Enum.withNameInsensitive$(Enum.scala:109)
        at org.thp.thehive.models.UserType$.withNameInsensitive(User.scala:16)
        at org.thp.scalligraph.models.UMapping$.$anonfun$enumeratum$2(Mapping.scala:96)
        at org.thp.scalligraph.models.Mapping.apply(Mapping.scala:132)
        at org.thp.scalligraph.models.SingleMapping.getProperty(Mapping.scala:197)
        at org.thp.thehive.models.User$$anon$10$$anon$11.<init>(User.scala:33)
        at org.thp.thehive.models.User$$anon$10.org$thp$thehive$models$User$$nestedInanon$10$$$anonfun$converter$4(User.scala:33)
[error] o.t.s.m.UMapping$string [d39feb69374cac0c|67d95006f8d9bae3] vertex 36992 doesn't comply with its schema, field login is missing:
v[36992]
[error] o.t.s.m.UMapping$string [d39feb69374cac0c|67d95006f8d9bae3] vertex 36992 doesn't comply with its schema, field name is missing:
v[36992]
[error] o.t.s.m.UMapping$boolean [d39feb69374cac0c|67d95006f8d9bae3] vertex 36992 doesn't comply with its schema, field locked is missing:
v[36992]
[error] o.t.s.m.SingleMapping [d39feb69374cac0c|67d95006f8d9bae3] vertex 36992 doesn't comply with its schema, field type is missing:
v[36992]
[error] o.t.s.traversal [d39feb69374cac0c|67d95006f8d9bae3] Traversal has generated an error
java.util.NoSuchElementException:  is not a member of Enum (Normal, Service)
        at enumeratum.Enum.$anonfun$withNameInsensitive$1(Enum.scala:111)
        at scala.Option.getOrElse(Option.scala:201)
        at enumeratum.Enum.withNameInsensitive(Enum.scala:111)
        at enumeratum.Enum.withNameInsensitive$(Enum.scala:109)
        at org.thp.thehive.models.UserType$.withNameInsensitive(User.scala:16)
        at org.thp.scalligraph.models.UMapping$.$anonfun$enumeratum$2(Mapping.scala:96)
        at org.thp.scalligraph.models.Mapping.apply(Mapping.scala:132)
        at org.thp.scalligraph.models.SingleMapping.getProperty(Mapping.scala:197)
        at org.thp.thehive.models.User$$anon$10$$anon$11.<init>(User.scala:33)
        at org.thp.thehive.models.User$$anon$10.org$thp$thehive$models$User$$nestedInanon$10$$$anonfun$converter$4(User.scala:33)
[info] o.t.s.AccessLogFilter [fd71fa1262f5a58c|683472fd1c9ca662] 172.19.0.5 GET /static/fonts/Montserrat/Montserrat-Light.ttf took 3ms and returned 200 242068 bytes
[info] o.t.s.AccessLogFilter [b1715f7f7fc3697e|8be3d6f92be12751] 172.19.0.5 POST /api/v1/chart/category took 2ms and returned 200
[info] o.t.s.AccessLogFilter [553190b7c4f8f5eb|041b21e86d29749d] 172.19.0.5 POST /api/v1/query?name=count-count-menu-get-global-tasks took 869ms and returned 200 1 bytes
[warn] o.t.s.u.Retry [a4bcdd888ce4f5a8|6280b2cec0f83b1b] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[347893928]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[error] o.t.s.traversal [a4bcdd888ce4f5a8|6280b2cec0f83b1b] Traversal has generated an error
java.lang.ClassCastException: class java.util.ArrayList cannot be cast to class org.apache.tinkerpop.gremlin.structure.Vertex (java.util.ArrayList is in module java.base of loader 'bootstrap'; org.apache.tinkerpop.gremlin.structure.Vertex is in unnamed module of loader 'app')
        at org.thp.thehive.models.Case$$anon$34$$anonfun$12.apply(Case.scala:87)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$2(ProjectionBuilder.scala:28)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.org$thp$scalligraph$traversal$ProjectionBuilder$$$anonfun$converter$1(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at scala.Function1.$anonfun$andThen$1(Function1.scala:85)
        at org.thp.scalligraph.traversal.Traversal.org$thp$scalligraph$traversal$Traversal$$$anonfun$domainMap$1(Traversal.scala:35)
[warn] o.t.s.u.Retry [a4bcdd888ce4f5a8|6280b2cec0f83b1b] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[434712592]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [a4bcdd888ce4f5a8|6280b2cec0f83b1b] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1008001152]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [a4bcdd888ce4f5a8|6280b2cec0f83b1b] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[556511440]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [a4bcdd888ce4f5a8|6280b2cec0f83b1b] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1048105016]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [768ca539878d73e0|3e11c8144b96ede1] 172.19.0.5 POST /api/v1/chart/category took 3ms and returned 200
[info] o.t.s.AccessLogFilter [cd21126d560fcedc|cbac9008f903f632] 172.19.0.5 POST /api/v1/chart/category took 2ms and returned 200
[info] o.t.s.AccessLogFilter [ddbed10d4ff3a54b|37fc0546ea9a3fd1] 172.19.0.5 POST /api/v1/query?name=count-all-get-all-alerts took 5ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [8cb907cfb5adcff8|c13cbf14f4a12cd9] 172.19.0.5 POST /api/v1/query?name=count-get-all-alerts took 16ms and returned 200 6 bytes
[info] o.t.s.AccessLogFilter [cb19b5785714b9bd|31ff0c4a4d466209] 172.19.0.5 POST /api/v1/query?name=get-all-alerts took 36ms and returned 200
[warn] o.t.s.u.Retry [cb19b5785714b9bd|31ff0c4a4d466209] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[286814424]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [cb19b5785714b9bd|31ff0c4a4d466209] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[368861336]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [2d166ebc6f563612|0dd0069ea5cf7109] 172.19.0.5 POST /api/v1/query?name=get-all-alerts took 8ms and returned 200
[info] o.t.s.AccessLogFilter [b2d8073cf6d7df40|6df0f70e20108488] 172.19.0.5 POST /api/v1/query?name=count-get-all-alerts took 8ms and returned 200 1 bytes
[info] o.t.s.AccessLogFilter [48a98efce898cdfc|6e944cbed83797ca] 172.19.0.5 POST /api/v1/query?name=list-all-observable-types took 10ms and returned 200
[info] o.t.s.AccessLogFilter [e9711e903df66b7c|5c3eac4ea3dfbb65] 172.19.0.5 POST /api/v1/chart/category took 3ms and returned 200
[info] o.t.s.AccessLogFilter [5600954caf101b33|b2758f44842d0580] 172.19.0.5 POST /api/v1/chart/category took 3ms and returned 200
[info] o.t.s.AccessLogFilter [e6413b3320aed0bb|7f227448bafc08ea] 172.19.0.5 POST /api/v1/query?name=count-all-get-all-cases took 5ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [0b44a5b8a4c17874|813e5a682f3a772a] 172.19.0.5 POST /api/v1/query?name=get-all-cases took 7ms and returned 200
[info] o.t.s.AccessLogFilter [a28614d81a4238b4|911506fad46acc30] 172.19.0.5 POST /api/v1/query?name=count-get-all-cases took 6ms and returned 200 5 bytes
[warn] o.t.s.u.Retry [0b44a5b8a4c17874|813e5a682f3a772a] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[347893928]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[error] o.t.s.traversal [0b44a5b8a4c17874|813e5a682f3a772a] Traversal has generated an error
java.lang.ClassCastException: class java.util.ArrayList cannot be cast to class org.apache.tinkerpop.gremlin.structure.Vertex (java.util.ArrayList is in module java.base of loader 'bootstrap'; org.apache.tinkerpop.gremlin.structure.Vertex is in unnamed module of loader 'app')
        at org.thp.thehive.models.Case$$anon$34$$anonfun$12.apply(Case.scala:87)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$2(ProjectionBuilder.scala:28)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.org$thp$scalligraph$traversal$ProjectionBuilder$$$anonfun$converter$1(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at scala.Function1.$anonfun$andThen$1(Function1.scala:85)
        at org.thp.scalligraph.traversal.Traversal.org$thp$scalligraph$traversal$Traversal$$$anonfun$domainMap$1(Traversal.scala:35)
[warn] o.t.s.u.Retry [0b44a5b8a4c17874|813e5a682f3a772a] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[434712592]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [0b44a5b8a4c17874|813e5a682f3a772a] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1008001152]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [20bc24af18de91d9|925a61a2c3853877] 172.19.0.5 POST /api/v1/chart/category took 11ms and returned 200
[info] o.t.s.AccessLogFilter [f4379e6686796db4|dae6ca22971f1bd9] 172.19.0.5 POST /api/v1/chart/category took 12ms and returned 200
[warn] o.t.s.u.Retry [0b44a5b8a4c17874|813e5a682f3a772a] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[556511440]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [0b44a5b8a4c17874|813e5a682f3a772a] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1048105016]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [494c0b7b5886a571|2bc532e7678d150c] 172.19.0.5 GET /api/stream/gqnJvwATtfdIIQFJUfiS took 60017ms and returned 200 2 bytes
[info] o.t.s.AccessLogFilter [26b4272f386985b8|45349ed6b485eea4] 172.19.0.5 POST /api/v1/query?name=get-all-cases took 138ms and returned 200
[info] o.t.s.AccessLogFilter [fccab7626101130d|45a440a96ed6e9ac] 172.19.0.5 POST /api/v1/query?name=count-get-all-cases took 142ms and returned 200 5 bytes
[warn] o.t.s.u.Retry [26b4272f386985b8|45349ed6b485eea4] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[347893928]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[error] o.t.s.traversal [26b4272f386985b8|45349ed6b485eea4] Traversal has generated an error
java.lang.ClassCastException: class java.util.ArrayList cannot be cast to class org.apache.tinkerpop.gremlin.structure.Vertex (java.util.ArrayList is in module java.base of loader 'bootstrap'; org.apache.tinkerpop.gremlin.structure.Vertex is in unnamed module of loader 'app')
        at org.thp.thehive.models.Case$$anon$34$$anonfun$12.apply(Case.scala:87)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$2(ProjectionBuilder.scala:28)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.org$thp$scalligraph$traversal$ProjectionBuilder$$$anonfun$converter$1(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at scala.Function1.$anonfun$andThen$1(Function1.scala:85)
        at org.thp.scalligraph.traversal.Traversal.org$thp$scalligraph$traversal$Traversal$$$anonfun$domainMap$1(Traversal.scala:35)
[warn] o.t.s.u.Retry [26b4272f386985b8|45349ed6b485eea4] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[434712592]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [26b4272f386985b8|45349ed6b485eea4] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1008001152]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [26b4272f386985b8|45349ed6b485eea4] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[556511440]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [26b4272f386985b8|45349ed6b485eea4] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1048105016]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [6d828821ec9134a0|24ee9a7719390fa5] 172.19.0.5 POST /api/v1/query?name=count-all-get-Playtech-users took 15ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [cecb81264f927ccc|dc8f4a7eea210d9c] 172.19.0.5 POST /api/v1/query?name=get-Playtech-users took 24ms and returned 200
[info] o.t.s.AccessLogFilter [5ec79c2cb88ad28b|409c8ef161ab757b] 172.19.0.5 POST /api/v1/query?name=count-get-Playtech-users took 25ms and returned 200 1 bytes
[error] o.t.s.m.UMapping$string [cecb81264f927ccc|dc8f4a7eea210d9c] vertex 24584 doesn't comply with its schema, field login is missing:
v[24584]
[error] o.t.s.m.UMapping$string [cecb81264f927ccc|dc8f4a7eea210d9c] vertex 24584 doesn't comply with its schema, field name is missing:
v[24584]
[error] o.t.s.m.UMapping$boolean [cecb81264f927ccc|dc8f4a7eea210d9c] vertex 24584 doesn't comply with its schema, field locked is missing:
v[24584]
[error] o.t.s.m.SingleMapping [cecb81264f927ccc|dc8f4a7eea210d9c] vertex 24584 doesn't comply with its schema, field type is missing:
v[24584]
[error] o.t.s.traversal [cecb81264f927ccc|dc8f4a7eea210d9c] Traversal has generated an error
java.util.NoSuchElementException:  is not a member of Enum (Normal, Service)
        at enumeratum.Enum.$anonfun$withNameInsensitive$1(Enum.scala:111)
        at scala.Option.getOrElse(Option.scala:201)
        at enumeratum.Enum.withNameInsensitive(Enum.scala:111)
        at enumeratum.Enum.withNameInsensitive$(Enum.scala:109)
        at org.thp.thehive.models.UserType$.withNameInsensitive(User.scala:16)
        at org.thp.scalligraph.models.UMapping$.$anonfun$enumeratum$2(Mapping.scala:96)
        at org.thp.scalligraph.models.Mapping.apply(Mapping.scala:132)
        at org.thp.scalligraph.models.SingleMapping.getProperty(Mapping.scala:197)
        at org.thp.thehive.models.User$$anon$10$$anon$11.<init>(User.scala:33)
        at org.thp.thehive.models.User$$anon$10.org$thp$thehive$models$User$$nestedInanon$10$$$anonfun$converter$4(User.scala:33)
[error] o.t.s.m.UMapping$string [cecb81264f927ccc|dc8f4a7eea210d9c] vertex 36992 doesn't comply with its schema, field login is missing:
v[36992]
[error] o.t.s.m.UMapping$string [cecb81264f927ccc|dc8f4a7eea210d9c] vertex 36992 doesn't comply with its schema, field name is missing:
v[36992]
[error] o.t.s.m.UMapping$boolean [cecb81264f927ccc|dc8f4a7eea210d9c] vertex 36992 doesn't comply with its schema, field locked is missing:
v[36992]
[error] o.t.s.m.SingleMapping [cecb81264f927ccc|dc8f4a7eea210d9c] vertex 36992 doesn't comply with its schema, field type is missing:
v[36992]
[error] o.t.s.traversal [cecb81264f927ccc|dc8f4a7eea210d9c] Traversal has generated an error
java.util.NoSuchElementException:  is not a member of Enum (Normal, Service)
        at enumeratum.Enum.$anonfun$withNameInsensitive$1(Enum.scala:111)
        at scala.Option.getOrElse(Option.scala:201)
        at enumeratum.Enum.withNameInsensitive(Enum.scala:111)
        at enumeratum.Enum.withNameInsensitive$(Enum.scala:109)
        at org.thp.thehive.models.UserType$.withNameInsensitive(User.scala:16)
        at org.thp.scalligraph.models.UMapping$.$anonfun$enumeratum$2(Mapping.scala:96)
        at org.thp.scalligraph.models.Mapping.apply(Mapping.scala:132)
        at org.thp.scalligraph.models.SingleMapping.getProperty(Mapping.scala:197)
        at org.thp.thehive.models.User$$anon$10$$anon$11.<init>(User.scala:33)
        at org.thp.thehive.models.User$$anon$10.org$thp$thehive$models$User$$nestedInanon$10$$$anonfun$converter$4(User.scala:33)
[info] o.t.s.AccessLogFilter [35800f64013f65ec|5e8cfdf48e92837e] 172.19.0.5 POST /api/v1/query?name=get-organisation-Playtech took 5ms and returned 200
[info] o.t.s.AccessLogFilter [e9e1d0deef24d44c|ce194b352d3eed49] 172.19.0.5 POST /api/v1/query?name=get-Playtech-users took 20ms and returned 200
[info] o.t.s.AccessLogFilter [2ce5ab7b1e704bbf|aefad01b6b22f5ae] 172.19.0.5 POST /api/v1/query?name=count-all-get-Playtech-users took 20ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [736df775c0f2caba|f3b1a0aef7b54bbb] 172.19.0.5 POST /api/v1/query?name=count-get-Playtech-users took 24ms and returned 200 1 bytes
[error] o.t.s.m.UMapping$string [e9e1d0deef24d44c|ce194b352d3eed49] vertex 24584 doesn't comply with its schema, field login is missing:
v[24584]
[error] o.t.s.m.UMapping$string [e9e1d0deef24d44c|ce194b352d3eed49] vertex 24584 doesn't comply with its schema, field name is missing:
v[24584]
[error] o.t.s.m.UMapping$boolean [e9e1d0deef24d44c|ce194b352d3eed49] vertex 24584 doesn't comply with its schema, field locked is missing:
v[24584]
[error] o.t.s.m.SingleMapping [e9e1d0deef24d44c|ce194b352d3eed49] vertex 24584 doesn't comply with its schema, field type is missing:
v[24584]
[error] o.t.s.traversal [e9e1d0deef24d44c|ce194b352d3eed49] Traversal has generated an error
java.util.NoSuchElementException:  is not a member of Enum (Normal, Service)
        at enumeratum.Enum.$anonfun$withNameInsensitive$1(Enum.scala:111)
        at scala.Option.getOrElse(Option.scala:201)
        at enumeratum.Enum.withNameInsensitive(Enum.scala:111)
        at enumeratum.Enum.withNameInsensitive$(Enum.scala:109)
        at org.thp.thehive.models.UserType$.withNameInsensitive(User.scala:16)
        at org.thp.scalligraph.models.UMapping$.$anonfun$enumeratum$2(Mapping.scala:96)
        at org.thp.scalligraph.models.Mapping.apply(Mapping.scala:132)
        at org.thp.scalligraph.models.SingleMapping.getProperty(Mapping.scala:197)
        at org.thp.thehive.models.User$$anon$10$$anon$11.<init>(User.scala:33)
        at org.thp.thehive.models.User$$anon$10.org$thp$thehive$models$User$$nestedInanon$10$$$anonfun$converter$4(User.scala:33)
[error] o.t.s.m.UMapping$string [e9e1d0deef24d44c|ce194b352d3eed49] vertex 36992 doesn't comply with its schema, field login is missing:
v[36992]
[error] o.t.s.m.UMapping$string [e9e1d0deef24d44c|ce194b352d3eed49] vertex 36992 doesn't comply with its schema, field name is missing:
v[36992]
[error] o.t.s.m.UMapping$boolean [e9e1d0deef24d44c|ce194b352d3eed49] vertex 36992 doesn't comply with its schema, field locked is missing:
v[36992]
[error] o.t.s.m.SingleMapping [e9e1d0deef24d44c|ce194b352d3eed49] vertex 36992 doesn't comply with its schema, field type is missing:
v[36992]
[error] o.t.s.traversal [e9e1d0deef24d44c|ce194b352d3eed49] Traversal has generated an error
java.util.NoSuchElementException:  is not a member of Enum (Normal, Service)
        at enumeratum.Enum.$anonfun$withNameInsensitive$1(Enum.scala:111)
        at scala.Option.getOrElse(Option.scala:201)
        at enumeratum.Enum.withNameInsensitive(Enum.scala:111)
        at enumeratum.Enum.withNameInsensitive$(Enum.scala:109)
        at org.thp.thehive.models.UserType$.withNameInsensitive(User.scala:16)
        at org.thp.scalligraph.models.UMapping$.$anonfun$enumeratum$2(Mapping.scala:96)
        at org.thp.scalligraph.models.Mapping.apply(Mapping.scala:132)
        at org.thp.scalligraph.models.SingleMapping.getProperty(Mapping.scala:197)
        at org.thp.thehive.models.User$$anon$10$$anon$11.<init>(User.scala:33)
        at org.thp.thehive.models.User$$anon$10.org$thp$thehive$models$User$$nestedInanon$10$$$anonfun$converter$4(User.scala:33)
[info] o.t.s.AccessLogFilter [b2e844d60eabe752|eb56be2581abf60f] 172.19.0.5 POST /api/v1/query?name=get-all-alerts took 20ms and returned 200
[info] o.t.s.AccessLogFilter [24df7dca4d7fe5e2|3ffe76d468f8f7b1] 172.19.0.5 POST /api/v1/query?name=count-get-all-alerts took 12ms and returned 200 1 bytes
[info] o.t.s.AccessLogFilter [b24488ad17df7aa9|842c1f5bc91efecd] 172.19.0.5 POST /api/v1/query?name=count-all-get-all-alerts took 22ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [7071c0fa7def855d|7497c2c130abaa00] 172.19.0.5 POST /api/v1/query?name=get-all-alerts took 6ms and returned 200
[info] o.t.s.AccessLogFilter [84e2dfec39ee9820|d5b58115c29af8d5] 172.19.0.5 POST /api/v1/query?name=count-get-all-alerts took 8ms and returned 200 6 bytes
[warn] o.t.s.u.Retry [7071c0fa7def855d|7497c2c130abaa00] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[286814424]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [7071c0fa7def855d|7497c2c130abaa00] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[368861336]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [722ea99255a4eb5f|04d47c6f5025f9c7] 172.19.0.5 POST /api/v1/query?name=get-all-alerts took 18ms and returned 200
[warn] o.t.s.u.Retry [722ea99255a4eb5f|04d47c6f5025f9c7] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[557248720]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [722ea99255a4eb5f|04d47c6f5025f9c7] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1253638368]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [722ea99255a4eb5f|04d47c6f5025f9c7] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[885379256]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [722ea99255a4eb5f|04d47c6f5025f9c7] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[639029408]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [2642f6c3ab8ca0e8|b3b6f2e4ba01a67d] 172.19.0.5 POST /api/v1/query?name=get-all-alerts took 5ms and returned 200
[warn] o.t.s.u.Retry [2642f6c3ab8ca0e8|b3b6f2e4ba01a67d] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1253257440]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [2642f6c3ab8ca0e8|b3b6f2e4ba01a67d] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[638664864]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [2642f6c3ab8ca0e8|b3b6f2e4ba01a67d] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[638660768]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [2642f6c3ab8ca0e8|b3b6f2e4ba01a67d] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1048420408]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (2/3)
b3belov commented 2 years ago

Log generated when I try to list cases:


[error] o.t.s.m.UMapping$long [9ca6f5e0ef7626b2|75f8c62d4574e00e] Case 422441024 doesn't comply with its schema, field timeToDetect is missing:
v[422441024]
 - _label = Case
**{CASE DATA}**
[error] o.t.s.m.SingleMapping [9ca6f5e0ef7626b2|75f8c62d4574e00e] Case 422441024 doesn't comply with its schema, field stage is missing:
v[422441024]
 - _label = Case
 **{ CASE DATA }**
[error] o.t.s.traversal [9ca6f5e0ef7626b2|75f8c62d4574e00e] Traversal has generated an error
java.util.NoSuchElementException:  is not a member of Enum (New, InProgress, Closed)
        at enumeratum.Enum.$anonfun$withNameInsensitive$1(Enum.scala:111)
        at scala.Option.getOrElse(Option.scala:201)
        at enumeratum.Enum.withNameInsensitive(Enum.scala:111)
        at enumeratum.Enum.withNameInsensitive$(Enum.scala:109)
        at org.thp.thehive.models.CaseStage$.withNameInsensitive(Case.scala:15)
        at org.thp.scalligraph.models.UMapping$.$anonfun$enumeratum$2(Mapping.scala:96)
        at org.thp.scalligraph.models.Mapping.apply(Mapping.scala:132)
        at org.thp.scalligraph.models.SingleMapping.getProperty(Mapping.scala:197)
        at org.thp.thehive.models.Case$$anon$34$$anon$35.<init>(Case.scala:87)
        at org.thp.thehive.models.Case$$anon$34.org$thp$thehive$models$Case$$nestedInanon$34$$$anonfun$converter$12(Case.scala:87)
[info] o.t.s.AccessLogFilter [02c70b9ed3fe7429|bbe6b422a24a85ec] 172.19.0.5 POST /api/v1/query?name=count-get-global-tasks took 5181ms and returned 200 4 bytes
[info] o.t.s.AccessLogFilter [1529217727e74820|d4926d93f13e2ce9] 172.19.0.5 GET /api/stream/dszx71YVy3Y5ScG7Rj8Y took 60019ms and returned 200 2 bytes
[info] o.t.s.AccessLogFilter [eb7433889cdacf53|e39267d7d71234d6] 172.19.0.5 GET /api/stream/dszx71YVy3Y5ScG7Rj8Y took 60015ms and returned 200 2 bytes
[info] o.t.t.c.m.s.MispActor [a2a3bba8cc87bd92|3a607e0268d4ce4e] Synchronising MISP events for PT-MISP
[info] o.t.t.c.m.s.MispActor [a2a3bba8cc87bd92|3a607e0268d4ce4e] MISP synchronisation is complete
[info] o.t.s.AccessLogFilter [cdd66dfa47eefa2d|f4fd8dc27254354b] 172.19.0.5 POST /api/v1/chart/category took 37ms and returned 200
[info] o.t.s.AccessLogFilter [84821e530b6a1202|b463c1bc9a5f13ca] 172.19.0.5 POST /api/v1/query?name=get-all-cases took 8ms and returned 200
[info] o.t.s.AccessLogFilter [e73600487c140658|f9ca41a2be37be64] 172.19.0.5 POST /api/v1/query?name=count-all-get-all-cases took 4ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [e6651a3dca13f4d9|8e157dcb864b419a] 172.19.0.5 POST /api/v1/query?name=count-get-all-cases took 11ms and returned 200 5 bytes
[warn] o.t.s.u.Retry [84821e530b6a1202|b463c1bc9a5f13ca] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[347893928]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[error] o.t.s.traversal [84821e530b6a1202|b463c1bc9a5f13ca] Traversal has generated an error
java.lang.ClassCastException: class java.util.ArrayList cannot be cast to class org.apache.tinkerpop.gremlin.structure.Vertex (java.util.ArrayList is in module java.base of loader 'bootstrap'; org.apache.tinkerpop.gremlin.structure.Vertex is in unnamed module of loader 'app')
        at org.thp.thehive.models.Case$$anon$34$$anonfun$12.apply(Case.scala:87)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$2(ProjectionBuilder.scala:28)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.org$thp$scalligraph$traversal$ProjectionBuilder$$$anonfun$converter$1(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at scala.Function1.$anonfun$andThen$1(Function1.scala:85)
        at org.thp.scalligraph.traversal.Traversal.org$thp$scalligraph$traversal$Traversal$$$anonfun$domainMap$1(Traversal.scala:35)
[warn] o.t.s.u.Retry [84821e530b6a1202|b463c1bc9a5f13ca] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[434712592]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [84821e530b6a1202|b463c1bc9a5f13ca] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1008001152]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [84821e530b6a1202|b463c1bc9a5f13ca] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[556511440]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [84821e530b6a1202|b463c1bc9a5f13ca] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1048105016]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [5f7a7c333f9eec25|d98cf41426879708] 172.19.0.5 POST /api/v1/query?name=get-all-cases took 13ms and returned 200
[info] o.t.s.AccessLogFilter [fedc2b78c73e8a36|6b39943a9b0c3777] 172.19.0.5 POST /api/v1/query?name=count-get-all-cases took 12ms and returned 200 5 bytes
[warn] o.t.s.u.Retry [5f7a7c333f9eec25|d98cf41426879708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[347893928]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[error] o.t.s.traversal [5f7a7c333f9eec25|d98cf41426879708] Traversal has generated an error
java.lang.ClassCastException: class java.util.ArrayList cannot be cast to class org.apache.tinkerpop.gremlin.structure.Vertex (java.util.ArrayList is in module java.base of loader 'bootstrap'; org.apache.tinkerpop.gremlin.structure.Vertex is in unnamed module of loader 'app')
        at org.thp.thehive.models.Case$$anon$34$$anonfun$12.apply(Case.scala:87)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$2(ProjectionBuilder.scala:28)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.org$thp$scalligraph$traversal$ProjectionBuilder$$$anonfun$converter$1(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at scala.Function1.$anonfun$andThen$1(Function1.scala:85)
        at org.thp.scalligraph.traversal.Traversal.org$thp$scalligraph$traversal$Traversal$$$anonfun$domainMap$1(Traversal.scala:35)
[warn] o.t.s.u.Retry [5f7a7c333f9eec25|d98cf41426879708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[434712592]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [5f7a7c333f9eec25|d98cf41426879708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1008001152]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [5f7a7c333f9eec25|d98cf41426879708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[556511440]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [5f7a7c333f9eec25|d98cf41426879708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1048105016]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [ac4123303b0a85a5|c2f059c8956a32a1] 172.19.0.5 POST /api/v1/query?name=get-all-cases took 40ms and returned 200
[warn] o.t.s.u.Retry [ac4123303b0a85a5|c2f059c8956a32a1] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[347893928]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[error] o.t.s.traversal [ac4123303b0a85a5|c2f059c8956a32a1] Traversal has generated an error
java.lang.ClassCastException: class java.util.ArrayList cannot be cast to class org.apache.tinkerpop.gremlin.structure.Vertex (java.util.ArrayList is in module java.base of loader 'bootstrap'; org.apache.tinkerpop.gremlin.structure.Vertex is in unnamed module of loader 'app')
        at org.thp.thehive.models.Case$$anon$34$$anonfun$12.apply(Case.scala:87)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$2(ProjectionBuilder.scala:28)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.org$thp$scalligraph$traversal$ProjectionBuilder$$$anonfun$converter$1(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at scala.Function1.$anonfun$andThen$1(Function1.scala:85)
        at org.thp.scalligraph.traversal.Traversal.org$thp$scalligraph$traversal$Traversal$$$anonfun$domainMap$1(Traversal.scala:35)
[warn] o.t.s.u.Retry [ac4123303b0a85a5|c2f059c8956a32a1] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[434712592]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [ac4123303b0a85a5|c2f059c8956a32a1] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1008001152]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [ac4123303b0a85a5|c2f059c8956a32a1] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[556511440]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [ac4123303b0a85a5|c2f059c8956a32a1] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1048105016]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [8c54e3b7b71aa1fe|9ff4168089ea3183] 172.19.0.5 POST /api/v1/query?name=get-all-alerts took 5ms and returned 200
[warn] o.t.s.u.Retry [8c54e3b7b71aa1fe|9ff4168089ea3183] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[286814424]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [8c54e3b7b71aa1fe|9ff4168089ea3183] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[368861336]->[JanusGraphVertexStep(OUT,[AlertAlertStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [e650b3103ac9b0bd|48303c6071d24fb1] 172.19.0.5 POST /api/v1/query?name=count-get-all-alerts took 6ms and returned 200 6 bytes
[info] o.t.s.AccessLogFilter [07e43f0aaa1f8c9d|fa58602452a7a18d] 172.19.0.5 POST /api/v1/query?name=count-all-get-all-alerts took 3ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [69d4bcad11189567|cd1b2f165824d99a] 172.19.0.5 POST /api/v1/query?name=count-all-get-all-cases took 4ms and returned 200 5 bytes
[info] o.t.s.AccessLogFilter [e10732eef8e01ded|8ffadccbe8f42916] 172.19.0.5 POST /api/v1/query?name=get-all-cases took 7ms and returned 200
[info] o.t.s.AccessLogFilter [f5fb1609ff3f1387|df4c1cc786919907] 172.19.0.5 POST /api/v1/query?name=count-get-all-cases took 7ms and returned 200 5 bytes
[warn] o.t.s.u.Retry [e10732eef8e01ded|8ffadccbe8f42916] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[347893928]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[error] o.t.s.traversal [e10732eef8e01ded|8ffadccbe8f42916] Traversal has generated an error
java.lang.ClassCastException: class java.util.ArrayList cannot be cast to class org.apache.tinkerpop.gremlin.structure.Vertex (java.util.ArrayList is in module java.base of loader 'bootstrap'; org.apache.tinkerpop.gremlin.structure.Vertex is in unnamed module of loader 'app')
        at org.thp.thehive.models.Case$$anon$34$$anonfun$12.apply(Case.scala:87)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$2(ProjectionBuilder.scala:28)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.$anonfun$by$4(ProjectionBuilder.scala:56)
        at org.thp.scalligraph.traversal.ProjectionBuilder.org$thp$scalligraph$traversal$ProjectionBuilder$$$anonfun$converter$1(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at org.thp.scalligraph.traversal.ProjectionBuilder$$anonfun$converter$2.apply(ProjectionBuilder.scala:61)
        at scala.Function1.$anonfun$andThen$1(Function1.scala:85)
        at org.thp.scalligraph.traversal.Traversal.org$thp$scalligraph$traversal$Traversal$$$anonfun$domainMap$1(Traversal.scala:35)
[warn] o.t.s.u.Retry [e10732eef8e01ded|8ffadccbe8f42916] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[434712592]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [e10732eef8e01ded|8ffadccbe8f42916] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1008001152]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [e10732eef8e01ded|8ffadccbe8f42916] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[556511440]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [e10732eef8e01ded|8ffadccbe8f42916] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1048105016]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[info] o.t.s.AccessLogFilter [37cbc93a042f61fd|a4e94bdb3f700708] 172.19.0.5 POST /api/v1/query?name=get-all-cases took 5ms and returned 200
[warn] o.t.s.u.Retry [37cbc93a042f61fd|a4e94bdb3f700708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[556081360]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [37cbc93a042f61fd|a4e94bdb3f700708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1251631328]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
[warn] o.t.s.u.Retry [37cbc93a042f61fd|a4e94bdb3f700708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1374142472]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
[warn] o.t.s.u.Retry [37cbc93a042f61fd|a4e94bdb3f700708] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[1005006976]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (2/3)
vdebergue commented 2 years ago

Hello,

It seems that there are some issues when trying to update both the index and running migration at the same time. I'd recommend to first change the index to ES, then upgrade to TH5.

If you can rollback the migration, I would recommend to try again by:

The config db.janusgraph.index.search.elasticsearch.bulk-refresh = false should make the indexing faster. But depending on the size of your data; you can try without

Meanwhile I will continue to investigate to see what goes wrong during this process.

vdebergue commented 2 years ago

After doing the same update as you, I was able to repair the database by running the migrations again. You can do this with this curl command:

curl -XPOST -u 'admin@thehive.local:secret' http://localhost:9000/api/v1/admin/schema/repair/thehive-enterprise

You should change the admin user and password by one configured in your instance. Also make sure that db.janusgraph.index.search.elasticsearch.bulk-refresh is removed from your config

I also did a "Database integrity check" for the Case entities due to an error (I think it was caused because I left bulk-refresh during the repair). You can find this in the admin section > Platform Management > Status The error in my logs was:

[warn] o.t.s.u.Retry [9bb4134bf9a4cc2f|18dfbd86dc452595] An error occurs (java.lang.IllegalArgumentException: The provided traverser does not map to a value: v[8320]->[JanusGraphVertexStep(OUT,[CaseCaseStatus],vertex)]), retrying (1/3)
b3belov commented 2 years ago

I rolled back to old version, migrated index to elastic, then updated TheHive image, as you recommended. Database update took almost 12 hours, but eventually it works okay. Thanks for the solution.

b3belov commented 2 years ago

Closing the issue.