search

VictoriaMetrics / VictoriaMetrics

VictoriaMetrics: fast, cost-effective monitoring solution and time series database
https://victoriametrics.com/
Apache License 2.0
11.39k stars 1.14k forks source link

VictoriaLogs UI sometimes loses log records in Firefox #6281

Closed eduardbareev closed 1 day ago

eduardbareev commented 1 month ago

Describe the bug

The number of rows displayed doesn't match the number of rows returned by server.

The issue appears in following browsers:

Chrome is not affected probably (never observed the issue)

Please see the video attached: viclogslostrows.webm

To Reproduce

There is no sure way to reproduce this

Version

victoria-logs-20240514-010820-tags-v0.6.1-victorialogs-0-gc90e6de13b

hagen1778 commented 1 month ago

@Loori-R could you please take a look?

Loori-R commented 1 month ago

@eduardbareev Hi, could you please send the server response when the logs is not displaying? This will help us identify the issue more easily.

eduardbareev commented 1 month ago

@eduardbareev Hi, could you please send the server response when the logs is not displaying? This will help us identify the issue more easily.

While suffering from bugs VictoriaLogs cannot sensibly respond to queries, suddenly it started to return different records in different order in unpredictable manner, therefore I can't make it to return those three records.

However it turned out that I left one of browsers with developer tools open. Attached are screenshot and a HAR file whose last entry corresponds to what's on screenshot.

viclogsui.har.json

viclogsui

eduardbareev commented 1 month ago

@Loori-R My observation is that whether a record would be missing from rendering correlates to the length of its _msg. In Firefox on my machine, a record with _msg of 100k chars have 9/10 chances to not have a row in a resulting table. Small messages are always displayed. With this 3-records dataset viclogs_jsonlines.txt a second row is the one that gets absent almost always.

Loori-R commented 1 month ago

@eduardbareev Thanks, your observations were very helpful! I have opened a pull request #6310 with the fix.

valyala commented 1 month ago

The fix has been included in VictoriaLogs v0.9.0. @eduardbareev , could you verify that the issue is fixed in this release?

eduardbareev commented 1 month ago

The fix has been included in VictoriaLogs v0.9.0. @eduardbareev , could you verify that the issue is fixed in this release?

can't open /select/vmui/? in 0.9.0, says 404. /select/vmui/? is where "select/vmui - Web UI for VictoriaLogs" link on / (main page) points to

eduardbareev commented 1 month ago

@valyala , checked 0.9.1, seems to me that the bug is gone.

By the way, I wanted to let you know about this feature request https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6301

Loori-R commented 1 day ago

The bug has been fixed in VictoriaLogs v0.9.0. You can test this change in our playground.