sirensolutions / kibi

PLEASE READ: Kibi is now "Siren Investigate", part of the Siren Platform. This code repository is only provided to facilitate code review and integration by Siren customers and cannot be successfully compiled. The code also requires Siren Federate to be installed in Elasticsearch.
http://siren.io
Other
494 stars 111 forks source link

Inconsistent numbers from scratch and when filters are applied #59

Closed stefanobortoli closed 8 years ago

stefanobortoli commented 8 years ago

Versions

Kibi: 4.5.3-4

Operating System:

Server Ubuntu 14.04-LTS, Browser Chrome 53.0.2785.116 m on Win 7 Pro

Behavior

Relational widget presents different numbers when applying sequential filters. In particular, the same object appears to have relations when filtered with a query on the top search box, and the same object did not have any relation when filtered using one of its properties.

Expected:

consistency in the relational widget up on different ways to filter the same object.

Actual:

the number of relations with other dashboard changes according the way we filter the same object.

Steps to reproduce the problem

attached the screencast: http://recordit.co/Nnm1dwlICE

rendel commented 8 years ago

Hi Stefano, could you send the configuration of your relations ? In particular the terms encoding parameter for each of your relation. Thanks.

bertol83 commented 8 years ago

This Kibi should be the Community Edition, so I think the terms encoding is fix to long.

stefanobortoli commented 8 years ago

It is the Enterprise version.

bertol83 commented 8 years ago

Ok, so go on Settings --> Relations and press on the grey pen for your relation image

and copy here your config

stefanobortoli commented 8 years ago

attached all the screenshots I thought could be helpful

veicoli-index-conf conf-relations formalita-index-conf relations-28092016

rendel commented 8 years ago

And if you click on the button (when it is count is equal to 1) to go to formalita, what is the result ? Is there one formalita document on the dashboard, or 0 ?

stefanobortoli commented 8 years ago

The filter says: "related to 2 from Veicoli", but the dashboard is empty.

stefanobortoli commented 8 years ago

formalita-vuota

scampi commented 8 years ago

what is the configuration of those buttons ?

scampi commented 8 years ago

In the next release, the relational filter visualization will have a spy panel, but for now the only way to get the queries behind it is through the dev inspector. Can you check what is the query sent ? It is one which name contains button so the easy way to get it is to type button in the request filter (if you use chrome).

stefanobortoli commented 8 years ago

ok, about the the previous questions: when there is 1 on the button of the relational widget (filter by plate number) and I click on it, I have a dashboard formalita with 1 object with the relation of 1 vehicle. When I click on the button with count 0 (filter by vehicle id number), then I have the empty dashboard with the message of 2 vehicle.

stefanobortoli commented 8 years ago

if you need, we could share the whole bundle privately.

scampi commented 8 years ago

if possible that'd be nice

stefanobortoli commented 8 years ago

how can I send the bundle? it is around 250MB

bertol83 commented 8 years ago

You should receive an email. I have shared a folder with you on google drive

stefanobortoli commented 8 years ago

I was doing the same, already uploading. I will either share that or upload here tomorrow morning.

Thanks a lot for the support!

Il 28 set 2016 6:38 PM, "Nicola" notifications@github.com ha scritto:

You should receive an email. I have shared a folder with you on google drive

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/sirensolutions/kibi/issues/59#issuecomment-250223334, or mute the thread https://github.com/notifications/unsubscribe-auth/AGIWAFDuniJe5d3aVVMvTADztUihXiUPks5qupfugaJpZM4KI0eZ .

jccq commented 8 years ago

guys this should be a ticket in the Customer Portal for the EE :)?

stefanobortoli commented 8 years ago

We can move it there. No problem. I have just shared the bundle with Nicola.

stefanobortoli commented 8 years ago

We restarted kibi, and for some obscure reasons the problems were solved. We keep it monitored to understand whether the problem appears again. Thanks a lot for the quick response and valid support received.

rendel commented 8 years ago

Hi @stefanobortoli, before seeing this issue, were you sending updates to the indices (e.g., adding or removing some documents) while Kibi was running ? (I am just wondering is this was not a caching issue somewhere).

stefanobortoli commented 8 years ago

I think so. Kibi was on while indexing the snipped of data used for the analysis.

rendel commented 8 years ago

If this happens again, could you try to run the command to clear the siren join cache:

$ curl -XGET 'http://localhost:9200/_filter_join/cache/clear

And then reload the kibi dashboard and see if the count changes as expected. If this is the case, please report this to us. Thanks.

stefanobortoli commented 8 years ago

I will certainly do. I guess the restart does the clear, right?

rendel commented 8 years ago

Restarting elasticsearch yes. But if you restarted only Kibi, then this means this is something on Kibi side, not siren join side. Did you restart Kibi or elasticsearch ?

stefanobortoli commented 8 years ago

We restarted everything, so we cannot help on this. However, we'll try to keep trace of these operations so that if we have troubles we can report.