rafal-szypulka / grafana-ibm-apm

Grafana datasource plugin for IBM APM
MIT License
28 stars 15 forks source link

Problem - Tivoli Enterprise Portal #29

Closed fernandofreitasti closed 4 years ago

fernandofreitasti commented 4 years ago

Please include this information:

fernandofreitasti commented 4 years ago

Grafana_Consulting Grafana_Consulting2 Grafana1 Grafana2

fernandofreitasti commented 4 years ago

The problem occurred when the chart was updated to a new version

rafal-szypulka commented 4 years ago

Just to make sure if I understood correctly. You upgraded the plugin to 0.9 (cloned from Github) and after that, you had some issues with existing dashboards that worked well in the previous version? Is it correct? First of all, the new version is experimental and try it only in test env. I do not guarantee that old dashboards will just work without any modifications because I added some new features. If you see problems with specific panels, you need to edit the panel and check its configuration.

  1. If the panel shows real-time data in a table or bar chart, make sure that you select "Time Range: Current value".
  2. Try to switch from "Value Attribute" from value to displayValue
  3. Check the Format setting. Table is only for table panels, but old table panels won't work properly with the new table format and most probably you need to recreate your table panels. If you want to still use old table panels, switch the format to timeserie.
fernandofreitasti commented 4 years ago

The problem started to occur after the Grafana update. An update to the plugin was an attempt to correct the problems.

desscartes commented 4 years ago

I have the same issue abouth my dahsboards, but I have very slow perfosmance plus that ıssue. I try to change all dashboards but slowness is a big problem for this.

when I downgrade my plugins 0.8 it works. But with 0.8 it kills my teps service on teps server. I have to find a way for use 0.9 because this issue.

how can we use 0.9 plugin? Am ı create all dashboards like new instalations?

fernandofreitasti commented 4 years ago

Hello desscartes,

in my case as a workaround I created a separate TEP, just for graphana. This helped improve performance.

I have a TEP for user access and one only for Grafana, where I create the dashboards.

desscartes commented 4 years ago

Hello Fernando,

Thanks

But now I have only 4 user on my teps. Actually my real problem My RestAPI lock when I call different times on my grafana graphs. After that I have to restart my teps service (cq). If I ceate a seperate TEP just grafana is it solution for me? Do you have any lock when you use grafana dashboards?

Thanks, Cenk

fernandofreitasti commented 4 years ago

In my case, you had approximately 100 users who use TEP.

Check if nginx is configured correctly and the call referrer "" is passing, a problem that occurred after configuring nginx.

desscartes commented 4 years ago

Thanks , I have an nginx confıguratıon like that for call referrer:

location /{
           proxy_pass http://localhost:3000/;
           proxy_Set_header Refer "";
        }

Is your lock problem's reason nginx configuration?

Now are you using 0.9 plugins with no error or lock?

fernandofreitasti commented 4 years ago

I had a problem with nginx but after I fixed it it is normal.

My plugin is working without error, since the creation of TEP just for him.

desscartes commented 4 years ago

I checked my teps system.out.logs but there is no "Rejecting rewquest due to invalid Referer attribute" logs. I have just nginix logs like below; "** upstream timed out (110:Connection timed out) while reading response header from upstream."

and on grafana page I have error like that.

"Panel randerıng error. can not read property 'prefix' or un defined"

rafal-szypulka commented 4 years ago

@fernandofreitasti sorry for the late reply. Is the issue solved now? @desscartes make sure that "Deallocate dataset... " option in the datasource config is enabled (this option seems to be disabled by default on 0.9 (my mistake))

fernandofreitasti commented 4 years ago

It was solved, I created a dedicated TEP and it's working well

desscartes commented 4 years ago

Hello Rafal,

At least I increase Heap Size again to 6 gb, it seems ok but I have still continue testing it.

thanks for your helps.

ruohki commented 3 years ago

Id like to piggyback on the issue. I increased the Heap size to 8gb (the ITM system only monitors 1 NT agent right now). Also i did setup a nginx to clear out the referer. Still no luck - after a couple of reads the portal server just freezes and i have to restart the whole vm