Declined
Last Updated: 14 Jan 2025 15:00 by ADMIN
Jeff
Created on: 13 Jan 2025 19:26
Type: Bug Report
0
Data bound test only runs first iteration when running selected steps or run from here

We've observed an odd behaviour where data driven tests set up with local data seem to only execute the first iteration when using the "run to here" and "run selected steps" options.  According to the log, it correctly identifies the test as being data driven, identifies that it is executing the first iteration but does not execute any further iterations.  (No errors or failures of subsequent iterations are present in the log).   This occurs regardless of if the test is run as a standalone test, or a test-as-step in a larger test (in which case, after running the first iteration of the sub-test, the next step in the parent following the test-as-step runs (and fails on a data validation error since the other iterations did not execute).

On further analysis we determined that if the entire test is fully executed, it does seem to find and run all iterations of the subtest, so it seems only the partial run options seem to be encountering the issue.

We're unsure if this is by design, or if there is a configuration setting that may control only 1 iteration running when using the other run options.

Thanks,


Jeff Harrison

1 comment
ADMIN
Elena
Posted on: 14 Jan 2025 15:00

Hello Jeff,

The behavior you describe for partial runs of data driven tests is by design. The partial test run options are very useful for debugging a test or a specific part of it, or adding new workflows in existing test. From our perspective in such cases the user doesn't need to wait for numerous iterations to add a couple of new steps in the test for example. This is why in this mode the test uses only the first line of data source for one single iteration of the test. 

The execution through the Execute button triggers a complete test run as it would be executed as part of a test list, for example. Thus this run includes execution using the complete data for data binding. 

On the other hand I would like to share one more feature of Test Studio that might be useful for you - Test Studio tests used as steps can either use their own data source, or inherit the data source of the parent test. Depending on that setting the final outcome of running the iterations is different. You can find additional information on the topic in this article

Based on the details you share I understand you have some data driven scenarios which bothers you and you are looking for an option to address these difficulties. If my assumption is correct I will encourage you to submit a support thread where we can discuss the case further and in depth. 

Thank you for your understanding and cooperation.

Regards,
Elena
Progress Telerik

Virtual Classroom is the free self-paced technical training portal that gets you up to speed with Telerik and Kendo UI products including Telerik Test Studio! Check it out at https://learn.telerik.com/.