search

ITISFoundation / osparc-simcore

🐼 osparc-simcore simulation framework
https://osparc.io
MIT License
46 stars 27 forks source link

Webserver started services metrics looks weird ("simcore_simcore_service_webserver_services_started_total") #3472

Closed elisabettai closed 1 year ago

elisabettai commented 2 years ago

Just looking with @sanderegg, there seems to be some problems (on AWS prod and master as well) for the webserver started services, e.g. this one&g0.tab=0&g0.stacked=0&g0.show_exemplars=0&g0.range_input=1w&g1.expr=sum(rate(simcore_simcore_service_director_services_started_total%7Bservice_key%3D%22simcore%2Fservices%2Fdynamic%2F3d-viewer-gpu%22%7D%5B1d%5D)1246060)&g1.tab=0&g1.stacked=0&g1.show_exemplars=0&g1.range_input=8w&g2.expr=&g2.tab=1&g2.stacked=0&g2.show_exemplars=0&g2.range_input=1h))

elisabettai commented 2 years ago

Hi @sanderegg, do you think you can look into that this sprint? We'll soon need to report on those metrics.

sanderegg commented 2 years ago

@elisabettai it might be possible. let's see during PM2.

elisabettai commented 1 year ago

Hi @sanderegg, any chance you have some bandwidth for this? We'd need those values for the report in two weeks.

sanderegg commented 1 year ago

@elisabettai I'll do my best and try to

sanderegg commented 1 year ago

@mrnicegyu11 , @elisabettai : All these metrics are multiplied by the number of instances of the webserver (e.g. typical 3x) now.

The issue has been isolated, but just that you know in case you compile values. This is due to the rabbitMQ sending these messages to all instances (the webserver).