search

ssl-hep / ServiceX

ServiceX - a data delivery service pilot for IRIS-HEP DOMA
BSD 3-Clause "New" or "Revised" License
19 stars 21 forks source link

Kibana needs to have an option to show only ERROR messages #788

Open ponyisi opened 3 months ago

ponyisi commented 3 months ago

Our log reporting needs to be able to display only the ERROR messages of a transformation. Given that every transformer will issue multiple INFO messages, a single ERROR may be very hard to track down, or even impossible since our Kibana displays have a 500 message limit (the ERROR may occur only further back).

This is particularly important for the log-url returned in a TransformStatus; it will be very confusing for users to have to wade through a huge number of INFO messages that are mostly tracking internal ServiceX machinery (which could be very important for us, but not so much for someone trying to find something like "my Python transformer code raised an exception").

ponyisi commented 2 months ago

This is partially mitigated by https://github.com/ssl-hep/ServiceX_frontend/pull/403 , but it would still be nice to have a simple filtering functionality from the dashboard you get from the "Logs" link on the ServiceX page.