Empty profiler results test-as-step on data driven test

Progress® Telerik® Test Studio® Feedback Portal

Create an account Log In

Back to Feed

Request a Feature Report a Bug

Completed

Last Updated: 09 Nov 2015 09:12 by ADMIN

ADMIN

Ivaylo

Created on: 21 Oct 2015 08:35

Type: Bug Report

Empty profiler results test-as-step on data driven test

Steps to reproduce:

1. Using the project attached internally execute the performance test list.

2. In Test Results drill down to the very bottom:

perf Tests - Test 1 > Parent Steps - Step 1 > Web Iterations - Test 1 > WebTest Steps

3. Click on the view Performance Results icon

Expected behavior: To be able to see the Performance Results

Actual behavior: Performance results are empty.


Here is a short video demonstration: http://screencast.com/t/8wHne72btI

7 comments

ADMIN

Daniel Djambov

Posted on: 09 Nov 2015 09:12

Telerik: I have logged a feature request for your case (http://feedback.telerik.com/Project/161/Feedback/Details/174592-show-iteration-information-for-performance-test-list-results), so our PM team can consider for future releases.

Alex

Posted on: 06 Nov 2015 09:23

I voted for the existing feature request by the linky that you have provided and I would not mind if you track another one.

For the storing the all iterations/steps in one place - it makes sense, but in such case it should be somehow visible which step row/data iteration is connected to each other, because it is really complicated to figure out such info. And while increasing the test data/iteration number the readability of such log decreases to none.

ADMIN

Daniel Djambov

Posted on: 06 Nov 2015 07:42

Telerik: to answer your question "But how can i understand what data was used for specific iteration from the main test log?" - actually it is much easier when you have all results from all iterations and steps in one place, you can sort the view by step name and you will have all your steps for all iterations in one view and can compare the performance data for each step easily, while if you have data for each iteration you will have to click several times to exit and enter iterations and search step inside and will not be able to compare performance data of steps in one view. The iteration number will not be shows in the main view however, so if you think current behavior will not fully suit your case, I can file a Feature Request for how you expect it to work. There is already such request http://feedback.telerik.com/Project/161/Feedback/Details/43479-performance-iterations-hard-to-compare , so you can vote for it if you like or add a comment and additional requirements. Thank you for your feedback!

Alex

Posted on: 05 Nov 2015 09:05

But how can i understand what data was used for specific iteration from the main test log?
For example i have a complicated test with a lot of test-as-steps (lets say it takes 30 steps in overall), and a binded data file with 32 rows, which means that test will be run 32 times (iterations). 
And after that the main test log will show 30 * 32 = 960 rows. Now i'm interested to get the client/server response time only for one specific step for each iteration. 
This means that I have to somehow find 32 rows that are repeated in that range of 960. This is impossible to find which log row is connected to specific iteration/data which was used, because iteration number/iteration data is not displayed anywhere in the main log.
How should i handle that?
Opposite way would be to navigate to specific iteration in the test results and load performance results for each iteration. But you say that it's not available.

ADMIN

Daniel Djambov

Posted on: 05 Nov 2015 06:56

Telerik: that is correct - we remove the button as it cannot provide iteration information. Still the performance information for the iterations is available in the main test, so you have iteration information shown, but not in iterations themselves rather in main test. This is because how performance test with data iterations currently work - it shows all steps from all iterations in the main test, so performance data is present there. Hope it is clear now.

Alex

Posted on: 04 Nov 2015 12:50

Does this mean that your fix will simply  remove the 'View performance results' button and still I would not be able to see the Performance results for specific Iterations?

ADMIN

Daniel Djambov

Posted on: 30 Oct 2015 16:40

Telerik: Profile results data button visibility is now limited to top level test results, because this test is configured for performance and holds all performance data. Other tests in it, which are test as steps, with iterations in them do not have actually performance results, that is why we have removed the icon for them. The fix will be available in our next internal product release, planned to be out by mid Nov 2015.