As more and more results are added to the storage service, it seems to significantly impact how long it takes for tests to start executing on a remote execution server. Once customer reports that in the beginning it took 5-7 minutes for execution to begin. After their DB file grew to 5GB, it now takes 20-25 minutes for execution to start. The size of the project did not change. It took them only one day of doing nothing but running multiple test lists to see this behavior.
Load traffic is not captured when using an existing web test with BaseURL set in the settings of the Project. Here is a short video demonstration of the problem: http://screencast.com/t/3tj1TsX03JLY
Steps to reproduce: 1. Navigate to an app containing input text element 2. Type in the input text element 3. Enable 'SimulateRealTyping' step property 4. Run the test in MS Edge Log exception: [02-23 16:02:33,ArtOfTest.Runner.exe(6096:4),Error] ExecutionEngine.CatchExecuteStepException() : EXCEPTION! (see below) Outer Exception Type: ArtOfTest.WebAii.Exceptions.ExecuteCommandException Message: ExecuteCommand failed! InError set by the client. Client Error: Unknown error BrowserCommand (Type:'Action',Info:'NotSet',Action:'InvokeJsFunction',Target:'ElementId (tagName: '',occurrenceIndex: '-1')',Data:'document.getElementsByTagName('input').focus()',ClientId:'8c513c4e-1f29-4088-a6d9-23dbbc6c3dbc',HasFrames:'False',FramesInfo:'',TargetFrameIndex:'-1',InError:'True',Response:'Unknown error') InnerException: none. HRESULT: 0x80131500 (Official ID (if app.) = COR_E_EXCEPTION, Error Bit = FAILED, Facility = FACILITY_URT, Code = 5376) Call Stack: at ArtOfTest.WebAii.Core.Browser.ExecuteCommandInternal(BrowserCommand request) at ArtOfTest.WebAii.Core.Browser.ExecuteCommand(BrowserCommand request, Boolean performDomRefresh, Boolean waitUntilReady) at ArtOfTest.WebAii.Core.Actions.InvokeScript(String script, Boolean refreshDom) at ArtOfTest.WebAii.ObjectModel.Element.GetValue[T](String propertyName, T defaultValue) at ArtOfTest.WebAii.ObjectModel.Element.GetValue[T](String propertyName) at ArtOfTest.WebAii.ObjectModel.Element.Focus() at ArtOfTest.WebAii.Controls.HtmlControls.HtmlControl.Focus() at ArtOfTest.WebAii.Design.IntrinsicTranslators.Descriptors.SetTextActionDescriptor.Execute(Browser browser) at ArtOfTest.WebAii.Design.Extensibility.HtmlActionDescriptor.Execute(IAutomationHost autoHost) at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep(Int32 order)
This is a limitation/bug in TestStudio. Here’s where the customer creates the variable: http://10.225.68.127:8080/prweb/PRServlet/nF-qFK4ha1B9XolnJtsJWpQlh9AKUteKa55vdjEHm_Y%5B*/!STANDARD?pzPostData=1316036933 <input type='hidden' id='pzHarnessID' value='HID1CE396E7F15CF6B5FC350407D4BF1FDD'> Test Studio is looking for values that are wrapped in double-quotes. For whatever reason, the server has decided to wrap its values in single quotes, which leads us to fail to identify this as a source. More information along with the test is provided in the internal description.
For various reasons we often update the identification logic to many elements that are used in our tests. Also very often, it happens that when recording a step against an element that is defined and working (i.e. the criteria is correct), Test Studio would none the less record the action against a new element. I tend to suspect it has to do with the fact that we tamper with the identification logic allot as mentioned above.
When performing the following steps to fill and update a popup form window: 1. Press Save_Button. 2. Wait for element 'Field_Country' 'is' visible. Test Studio produces the following error: Unexpected error while waiting on condition. Error: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> ArtOfTest.WebAii.Exceptions.ExecuteCommandException: ExecuteCommand failed! InError set by the client. Client Error: System.NullReferenceException: Object reference not set to an instance of an object.
When executing test lists in a larger project there is huge delay before the test list start executing. There is a long wait between each test in the list as well. Steps to reproduce provided in the internal description.
Steps to reproduce: 1. Open a project from TFS. 2. Toggle on/off a step feature "Continue on Failure' only once. 3. Check in to TFS, get latest version of project. Expected: The check in to prompt for saving the test files locally and then check in Actual: Only check in dialog is displayed. If you get latest version after the check in the change would not be present.
When using the VS plugin, if you change the code behind file to use a custom base class (which in turn inherits from BaseWebAiiTest), when you double click on a coded step to open it, the code behind file does open, but the all the coded steps in the test "magically" disappear. Doing the same sequence in Test Studio does not have this problem. A project that shows this problem is attached to the internal bug report.
When you change a Page property in the Visual Studio's Elements Explorer, the changes are not applied if you don't have at least one test opened which contains an element from that Page. Visually the Page property is changed, but if you close and reopen the VS solution you'll notice that the changes you made are reverted back to their previous state. However if you have a currently opened test which contains an element from that Page, the test will be marked as 'dirty' and the changes will be saved succesfully.
The test environment: * Master test suite is at about 240 tests and growing. * This is currently divided into 9 test lists of varying sizes. * The execution lab currently is 4 physical desktop machines. I schedule the test lists to run across these 4 machines. When I want to see the results of the test lists, I may be able to look at one or two test list results. But, it appears the application holds all these results in memory. Therefore, as I move through and look the results of each list I encounter out of memory exception and Test Studio crashes. Sometimes gracefully (with the prompt to save work) and sometimes it just disappears. The workaround is to leave the test results tab after viewing one or two lists. However this further slows down and disrupts the process of reviewing the results.
Steps to reproduce: 1. Copy and Paste an existing test case (bound to an Excel datasource) 2. Rename the new copy and save it. 3. Change the data binding or any other step in the new saved copy and save again. 4. Close and open the project. Expected: All changes to be saved in the newly copied and renamed test. Actual: Only the new name is saved but all further changes are not present. Note: On the other hand if the save action in step 2. is missed and all changes are saved with a single save action, all of them are present after reopening the project.
Steps to reproduce: 1. Create a test and start recording aginst: http://spread.grapecity.com/Demos/JS/ViewsDemo/#/demos/EditorMode 2. Highlight some cell in the grid. 3. Click on locate in DOM Expected: The element should be located in DOM. Actual: No element is found. The element is within an iFrame however Test Studio is not able to see any element in that frame.
Steps to reproduce: 1. Close & re-launch Test Studio. 2. Make sure there are no pending changes for the project. 3. Go the Test Lists tab & schedule a test list 4. Choose option to receive test results by E-mail, enter an e-mail address & click Done. 5. Click the Tests tab & note that the project shows a pending save and a pending change. 6. Right-click on the project & select Check In to TFS from the context menu. Click Save. 7. The Check In to TFS screen is displayed with no pending changes. Visual Studio (TFS) does not show a pending change.
Steps to reproduce: 1. Open Project 2. Copy / Paste a Test 3. Rename the Test 4. Open the copied test and change a test parameter 5. Save the project 6. Relaunch Test Studio and reopen the project 7. Open the same test again 8. The previously edited steps parameter is not changed
While connecting to Jira Cloud (https://name.atlassian.net) with valid userid and password, its giving error message "The remote server returned an error :(401) Unauthorized".
We are trying to use the performance profiling feature and are hitting an issue trying to open the results via Test Studio. From the trace file we can see that it is an out of memory error while parsing the JSON. The file is large, but not that large (150 MB). Here is the exception: [10/16 12:00:49,Telerik.TestStudio.exe(8208:11),Error] PerformanceMainViewModel.LoadLocalPerformanceResults() : EXCEPTION! (see below) Situation: Failed to extract metadata from "C:\Users\manor\Downloads\perf results\130263250855318769 CM7CreateAndLoop.tsperf". Outer Exception Type: System.OutOfMemoryException Message: Exception of type 'System.OutOfMemoryException' was thrown. HRESULT: 0x8007000E (Official ID (if app.) = E_OUTOFMEMORY, Error Bit = FAILED, Facility = FACILITY_WIN32, Code = DNS_ERROR_NO_MEMORY) Call Stack: at System.Text.StringBuilder.ToString() at System.IO.StreamReader.ReadToEnd() at System.IO.File.InternalReadAllText(String path, Encoding encoding, Boolean checkHost) at System.IO.File.ReadAllText(String path) at ArtOfTest.WebAii.Design.Execution.Profiler.Storage.ProfilerResultsFile.Load(Guid testGuid, String strFilePath, ResultsFileXmlRoot loadedResultObj) at ArtOfTest.WebAii.Design.UI.PerformanceMainViewModel.LoadLocalPerformanceResults()
When using Frame Tagging, it is not possible to locate elements on a tagged frame when referencing the elements from coded steps. For repro see the attached project in the internal description with more details.
In a specific customer application, when we use "Wait for visible" test steps, Test Studio randomly fails the test step with the following exception: ArtOfTest.Common.Design.Exceptions.VerificationWaitException: Unexpected error while waiting on condition. Error: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> ArtOfTest.WebAii.Exceptions.ExecuteCommandException: ExecuteCommand failed! InError set by the client. Client Error: System.ArgumentException: Tag collection is either empty or has less elements than the element occurrence requested. RequestedIndex: '2', ElementLength: '1' Steps to reproduce and a sample test project are attached in the internal description.