Progress® Telerik® Test Studio® Feedback Portal
Back to Feed
Request a Feature Report a Bug
Under Review
Last Updated: 28 Feb 2022 14:27 by ADMIN
Stéphane
Created on: 22 Feb 2022 20:34
Type: Bug Report
2
Failure of most of our Test Scenarios after the upgrade to Test Studio 2022.1.215.0

Hello,

We have a suite made of 23 test scenarios which are made up of hundreds of test steps. They have been running fine and passing as expected in the previous version of Test Studio (version 2021.3.1103.0). In order to support the most recent version of browsers (Google Chrome and MS Edge), we upgraded Test Studio to the most recent version (version 2022.1.215.0). During the upgrade, Test Studio automatically upgraded all the test scripts. However since the upgrade, only 8 of the 23 test scenarios have been passing as expected even though the target web app has not changed i.e. the web app is not the problem.

  • Here is the error returned when executing one of the failing test scenario against Google Chrome Version 98.0.4758.102 (Official Build) (64-bit):

    ArtOfTest.Common.Design.Exceptions.ExecutionException: ExecuteCommand failed!InError set by the client. Client Error:Evaluation failed: SyntaxError: Invalid or unexpected tokenBrowserCommand (Type:'Action',Info:'NotSet',Action:'SetText',Target:'ElementId (tagName: 'textarea',occurrenceIndex: '0')',Data:'This is a regression test note to test note area text field. You can enter any number, text or any characters here.
    eg :- 12.57980
    * # @ +
    assura@co.nz',ClientId:'662245DAE606F8418F6D8F8916AB8CD6',HasFrames:'False',FramesInfo:'',TargetFrameIndex:'0',InError:'True',Response:'Evaluation failed: SyntaxError: Invalid or unexpected token')
    InnerException: none.
    ---> ArtOfTest.WebAii.Exceptions.ExecuteCommandException
       at ArtOfTest.WebAii.Core.Browser.ExecuteCommandInternal(BrowserCommand request)
       at ArtOfTest.WebAii.Core.Browser.ExecuteCommand(BrowserCommand request, Boolean performDomRefresh, Boolean waitUntilReady)
       at ArtOfTest.WebAii.Core.Browser.ExecuteCommand(BrowserCommand request)
       at ArtOfTest.WebAii.Core.Actions.SetText(Element targetElement, String text)
       at ArtOfTest.WebAii.Design.IntrinsicTranslators.Descriptors.SetTextActionDescriptor.Execute(Browser browser)
       at ArtOfTest.WebAii.Design.Extensibility.HtmlActionDescriptor.Execute(IAutomationHost autoHost)
       at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep(Int32 order)
       --- End of inner exception stack trace ---
  • Here is another error returned when executing one of the failing test scenario against Google Chrome Version 98.0.4758.102 (Official Build) (64-bit):

    ArtOfTest.Common.Design.Exceptions.ExecutionException: Invalid control '[Element: 'li:0' (id=k-tabstrip-tab-0)]'.  Control does not match FindExpression '[role 'Exact' tab]' ---> System.ArgumentException: Invalid control '[Element: 'li:0' (id=k-tabstrip-tab-0)]'.  Control does not match FindExpression '[role 'Exact' tab]'
       at ArtOfTest.WebAii.Controls.Control.CreateInstance[TControl](Element e, Boolean throwIfNull)
       at Telerik.TestStudio.Translators.KendoUI.Angular.TabStrip.VerificationDescriptors.TabTitleVerificationDescriptor.ExtractData(IAutomationHost targetHost, DescriptorValueStore dataStore)
       at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep(Int32 order)
       --- End of inner exception stack trace ---

Can you please look into this and help us resolve whatever root cause prevents our suite of tests from executing and passing as expected with the most recent version of Telerik Test Studio? Thanks in advance.

Stéphane C. (Senior Software Tester at Assura Software)

Duplicated Items
5 comments
ADMIN
Elena
Posted on: 28 Feb 2022 14:27

Hello Stéphane,

The solution was provided in a private support ticket opened on behalf of Hamish Howard. This can be reviewed in their Telerik account under this link. Please, use that private thread to follow up on the case if you have any additional questions. 

Thank you for your understanding in advance.

Regards,
Elena
Progress Telerik

Virtual Classroom, the free self-paced technical training that gets you up to speed with Telerik and Kendo UI products quickly just got a fresh new look + new and improved content including a brand new Test Studio course! Check it out at https://learn.telerik.com/.
Stéphane
Posted on: 27 Feb 2022 20:20

Hello,

 

The ticket raised against the e-mail account linked to Telerik Test Studio licence has been closed as duplicate (Failure of most of our Test Scenarios after the upgrade to Test Studio 2022.1.215.0 (telerik.com)). So, I assume that the present ticket will be quickly addressed.

Can you please provide Assura Software with the solution that your support person, Elena, said you have in the message posted on 25 Feb 2022 02:49? Thanks in advance.

 

Best regards,

Stéphane C. (Senior Software Tester at Assura Software)

Stéphane
Posted on: 24 Feb 2022 20:29

Hello,

 

As advised by Elena, I have just lodged the present ticket against the e-mail account Assura Software's Telerik Test Studio licence is registered with: https://feedback.telerik.com/teststudio/1555311-failure-of-most-of-our-test-scenarios-after-the-upgrade-to-test-studio-2022-1-215-0

 

Best regards,

Stéphane C. (Senior Software Tester at Assura Software)

ADMIN
Elena
Posted on: 24 Feb 2022 13:49

Hi Stéphane,

I am sorry to hear you encountered such inconsistent behavior and will assist you with sorting this out. 

The issue is related to the Telerik and Kendo controls and their major release this year (R1 2022), which introduced a lot of changes in the view and structure for all controls. Test Studio strives to be up-to-date with the latest version of the controls and to support their automation. So far, this didn't affect the previous versions of the Kendo and Telerik controls generally and the tests for already built applications used to work despite of the upgrade. 

However, the recent changes in the latest version of the controls required complete rework of the Test Studio built-in translators and these are no longer backwards compatible out-of-the-box. Thus, with the upgrade of Test Studio the controls used in the application you test cannot be recognized as they are not the latest. 

We have a solution for this, but I noticed that this current account doesn't have active Test Studio license. Therefore, I will kindly ask you to use a licensed Telerik account to submit a support ticket and get further assistance on this topic.

Thank you for your understanding in advance. 

Regards,
Elena
Progress Telerik

Virtual Classroom, the free self-paced technical training that gets you up to speed with Telerik and Kendo UI products quickly just got a fresh new look + new and improved content including a brand new Test Studio course! Check it out at https://learn.telerik.com/.
Stéphane
Posted on: 22 Feb 2022 20:41

Hello,

 

Forgot to mention in the ticket that of course all the target browsers are calibrated in Test Studio. Also, option "User browser extension (Chrome) is unticked as per attached screenshot.

 

Stéphane C. (Senior Software Tester at Assura Software)

Attached Files:
Create an account Log In
View
Type
Status