search

airavata-courses / CAPtivate

Experiments with distributed system design for Applied Distributed Systems course
0 stars 4 forks source link

Troubleshooting and analysis using Kiali and Grafana #127

Open shubhangis91 opened 4 years ago

shubhangis91 commented 4 years ago

Visualize application services and their interaction to assess networking and traffic issues

shubhangis91 commented 4 years ago

Kiali dashboard provides routing information with features like Traffic Animation, edge labeling denoting requests distribution between versions of the service. This would help visualize how the traffic actually gets distributed between different versions.

shubhangis91 commented 4 years ago

To further granularize the problem, Grafana Dashboard could be utilized to monitor the actual amount of traffic being routed to different versions. The service and workload dashboards can be used to see graphs charting the workloads on the services, i.e. the traffic directed to each service. This was used to realize if the number of requests directed to different versions was the same as that defined in the virtual service and destination rule for the UI service or not. Since manually checking the difference in services is not possible because the division in workload is not precise and contains a little randomness, collecting and reading data over time helped in monitoring and assessing the actual distribution