huserben / PerformanceTestVisualizer

Visualizes TFS TestRuns
MIT License
1 stars 0 forks source link

Testrun Performance Analyzer : publish load test results #1

Open SreenivasReddyS opened 6 years ago

SreenivasReddyS commented 6 years ago

we are running load test from VSTS build using Apche Jmeter , i want to create trend-charts for my load test using Testrun Performance Analyzer extension, added that in my task list , but i am not able to find the test trend-chart after test. name of the test run ?

image

image

huserben commented 6 years ago

Hi @SreenivasReddyS

the name of the test run must match the name you give your runs in the main build. grafik

Then the task only will fetch the data from the server and create CSV files that can be used. In the github repository there are 2 python scripts that create line charts and html files with them, please have a look at them. You can see the description here and here

Hope that helps.

Please let me know whether it worked or not.

SreenivasReddyS commented 6 years ago

Thank you for below e-mail.

But I tried that, it is not working and I am confusing where the csv files/html stores, I am running my test from using Jmeter and test name I am giving Loadtest .

Please find below screenshots and correct me if I am wrong. [cid:image002.png@01D42B42.E7E44640][cid:image003.png@01D42B42.E7E44640]

Regards, Sreenivas.

From: Benj Huser notifications@github.com Sent: Friday, August 3, 2018 12:58 AM To: huserben/PerformanceTestVisualizer PerformanceTestVisualizer@noreply.github.com Cc: Sreenivasula Reddy Sirigireddy (ZEN3 Infosolutions Private Ltd) v-sresir@microsoft.com; Mention mention@noreply.github.com Subject: Re: [huserben/PerformanceTestVisualizer] Testrun Performance Analyzer : publish load test results (#1)

Hi @SreenivasReddyShttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FSreenivasReddyS&data=02%7C01%7Cv-sresir%40microsoft.com%7C57ff48d7c3584cac5fae08d5f8ae04db%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636688348650416923&sdata=FHiuFkf0SHBb%2FSaMUMYui5hvgg6%2FW96qGtnotf4aBNk%3D&reserved=0

the name of the test run must match the name you give your runs in the main build. [grafik]https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fuser-images.githubusercontent.com%2F5486874%2F43606048-911f2c58-969a-11e8-8701-a432cbac072c.png&data=02%7C01%7Cv-sresir%40microsoft.com%7C57ff48d7c3584cac5fae08d5f8ae04db%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636688348650426932&sdata=Oy%2Fz%2By6TDheOD%2BsVAJzbVvt24EuzjTqaAd2fUqx0O00%3D&reserved=0

Then the task only will fetch the data from the server and create CSV files that can be used. In the github repository there are 2 python scripts that create line charts and html files with them, please have a look at them. You can see the description herehttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fhuserben%2FPerformanceTestVisualizer%23creating-the-charts&data=02%7C01%7Cv-sresir%40microsoft.com%7C57ff48d7c3584cac5fae08d5f8ae04db%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636688348650426932&sdata=9o%2Be2F1sO4DoxObAZwmk8SsYcSU%2BlGCjb%2BRnMdqQLJ4%3D&reserved=0 and herehttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fhuserben%2FPerformanceTestVisualizer%23creating-the-html-file&data=02%7C01%7Cv-sresir%40microsoft.com%7C57ff48d7c3584cac5fae08d5f8ae04db%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636688348650436941&sdata=SOyc%2BSPhVRBcTpLAHKSlLiBKi09BloEkwaIDuFoCTs4%3D&reserved=0

Hope that helps.

Please let me know whether it worked or not.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fhuserben%2FPerformanceTestVisualizer%2Fissues%2F1%23issuecomment-410040672&data=02%7C01%7Cv-sresir%40microsoft.com%7C57ff48d7c3584cac5fae08d5f8ae04db%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636688348650436941&sdata=t2Gky0Hf9lc7HyclByo6IqljjLqf0rMWbZ0oqzBAH6M%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAYyyCGp7wK7ZP4T6Gfube9vjI2Qfrhhoks5uM1KsgaJpZM4VcU0b&data=02%7C01%7Cv-sresir%40microsoft.com%7C57ff48d7c3584cac5fae08d5f8ae04db%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636688348650446946&sdata=67w39iWV6ExHa5EUTtrqQCaUAmaljdT2CoqPpAPFhmg%3D&reserved=0.

huserben commented 6 years ago

Hi again

the CSV files are stored in the staging directory:

The csv files are created into the staging directory of the build agent that runs the test. They are put under a folder names PerformanceAnalyzer. For further scripts that run as part of the same build definition they would be available through this path: $(Build.ArtifactStagingDirectory)/PerformanceAnalyzer

To see whether they are there, you could just publish them and see if they appear as artifact. Check the documentation of the task at https://marketplace.visualstudio.com/items?itemName=benjhuser.test-run-performance-analyzer&targetId=12d83491-05ec-4d25-9701-6ee9a0e83256&utm_source=vstsproduct&utm_medium=ExtHubManageList for a description of how to do that.

I'm sorry I don't see any screenshot in your post, only the following:

[cid:image002.png@01D42B42.E7E44640][cid:image003.png@01D42B42.E7E44640]

I don't know JMeter, but it will only work if you can publish those results to the TFS/VSTS Server Instance, meaning that they appear under the Tests/Runs tab.

SreenivasReddyS commented 6 years ago

attaching screenshots vsts1 vsts2

huserben commented 6 years ago

Hi

ok, so I cannot really see anything that would relate to the name of the TestRun. Maybe can you try opening the Tests/Runs page and see if you have any entries from your Load Tests created there?

SreenivasReddyS commented 6 years ago

Hi ,

thanks for your reply.

i don't see any Load test run from Tests/Runs page,but i can see from Load test tab. also i am running my load test using ' Cloud-based Apache JMeter Load Test ', also added publish artifacts task.

also i have one doubt about this plugin , is this plugin will work when we run the test from' Cloud-based Apache JMeter Load Test ' , from where this plugin will collect the logs(.csv) for the entered test run.

huserben commented 6 years ago

Hi again

I'm sorry but I think then the task will not work. Currently it only supports regular Test Runs and no load tests.

SreenivasReddyS commented 5 years ago

Hi, where the csv files will store , if i am running Jmeter test, i can see only taskkey

Thanks, Sreenivas.

huserben commented 5 years ago

Hi

I'm sorry I don't get your question. Could you elaborate on the issue?