I have updated to the latest version of Test Studio Ultimate 2019.1.212.0 and now my test lists are not running in the order I have them set-up.
Posted on:18 Mar 2019 15:07
Sean is correct - the fix is included in the latest internal build version 2019.1.307 and this can be downloaded from your Telerik account here. In case you face any troubles, please do not hesitate to get in contact with our Support service.
@Sean: Thanks very much for assisting us in this thread.
Appears to have been fixed in latest internal build
Posted on:15 Mar 2019 15:50
Any update on this?
Posted on:04 Mar 2019 06:08
We are expecting to have an Internal Build released this week (5-7 March) 2019, where the change will be available.
Please make sure to turn on your Check For Update setting to look for Internal Build updates also and you will have automation notification, when starting Test Studio that the new release is available.
As the proposed workaround is really time consuming and you do not have sufficient time to spend right now, the other possible approach will be to rollback to the previous version of Test Studio. Please ensure all components are completely uninstalled before you get to installing the previous release - Test Studio standalone application and all Run-time editions installed on the execution machines. Then, selecting the correct version, download the full product installation from your account here and the Run-time edition here.
Please accept our sincere apology for the caused inconvenience once again.
Also, have in mind that I have converted the current support thread to a public bug report as the issue is on our end and we will work on resolving this as soon as possible.
If I roll back to the previous version including the runtime will this issue occur still? I have a release next week and I do not know if I will have time to create new tests with all my other test as steps.
Posted on:13 Feb 2019 15:13
Thank you for contacting us. I am sorry to hear you have encountered any misbehavior with out latest official release and will share some details on that.
Lately we've been working on improving the Scheduling service stability in general and the current R1 2019 release introduces, recovery for the execution clients, improvement the communication flow between the different components and other enhancements in the scheduling behavior in overall. With all of these we have improved the responsiveness of the execution agents and it seems the tests included in a static test list are not always following the order from the list during execution.
I suppose you have included tests in the test lists, which you expect to follow the listed order when executed. However, in this release the execution order may not always follow the test list order. As this is a major change in the behavior, we are already working on adjusting this to work as it is expected to. I hope that quite soon I will be able to get back to you with a permanent solution.
In the meantime there is a workaround you can apply until we have a solution to continue using the current setup you have built so far. To ensure the order of execution, you can create a parent test and include the necessary tests in the desired order to be executed as steps. Then, insert this parent test into a new test list and use it to run the tests in the expected order.
Please excuse us for any inconvenience caused and in case of any questions, do not hesitate to get back to me. Once there are any news on this case, I will get back in contact with you. Thanks in advance for your understanding.