The test list events are fired in case of running on the scheduling server, however the problem occurs in case of running on the execution client setup (out of the server). Steps to reproduce: 1. Create your own execution extension. 2. Override OnBeforeTestlistStarted and OnAfterTestListCompleted. 3. Create a test list and run it remotely. Expected: OnBeforeTestListStarted and OnAfterTestListCompleted are called. Actual: OnBeforeTestListStarted and OnAfterTestListCompleted aren't called.
1. Create local data for a test.
2. Data bind the same test to external data source.
3. Remove the data binding to the external source.
At this point I can't use the local data for data driven test steps or find expressions.
The workaround is to right click on the test and go to Properties. Then enable both DataEnabled and DefaultToGrid.
When you are in recording mode (with the Recorder attached to the browser) and execute a Test as Step with Run -> From Here or Selected option, the dialogs in that test are not handled.
The dialogs are handled, if you open the test from the Test as Step and use the same options Run -> From Here or Selected for the test itself.
When I close the Remote Desktop connection, the Test Runner on my VM reconnects to the Windows session successfully, but it does not set the correct resolution.
It seems to default to a base resolution and not the one from Change Console Resolution settings in the Test Runner.
In record mode, select two steps to execute with Run->Selected Steps - one which triggers the dialog, and the other to handle it. Expected: To handle the dialog Actual: The Handle dialog step times out.
----2013.1.1210-----
While making changes to an element's find logic, I received an error.
After this error happened, it broke every element and then I had to relaunch test studio to get rid of this compiler error.
[12/09 10:21:29,Telerik.TestStudio.exe(6040:27),ProjectModel] Project.RegenerateElementsCode() : EXCEPTION! (see below)
Situation: Trouble generating project elements file on first attempt
Outer Exception Type: System.InvalidOperationException
Message: Collection was modified; enumeration operation may not execute.
HRESULT: 0x80131509 (Official ID (if app.) = COR_E_INVALIDOPERATION, Error Bit = FAILED, Facility = FACILITY_URT, Code = 5385)
Call Stack:
at System.Collections.ArrayList.ArrayListEnumeratorSimple.MoveNext()
at Microsoft.CSharp.CSharpCodeGenerator.GenerateNestedTypes(CodeTypeDeclaration e)
at Microsoft.CSharp.CSharpCodeGenerator.GenerateType(CodeTypeDeclaration e)
at Microsoft.CSharp.CSharpCodeGenerator.System.CodeDom.Compiler.ICodeGenerator.GenerateCodeFromType(CodeTypeDeclaration e, TextWriter w, CodeGeneratorOptions o)
at Microsoft.CSharp.CSharpCodeGenerator.GenerateTypes(CodeNamespace e)
at Microsoft.CSharp.CSharpCodeGenerator.GenerateNamespace(CodeNamespace e)
at Microsoft.CSharp.CSharpCodeGenerator.System.CodeDom.Compiler.ICodeGenerator.GenerateCodeFromNamespace(CodeNamespace e, TextWriter w, CodeGeneratorOptions o)
at Microsoft.CSharp.CSharpCodeGenerator.GenerateNamespaces(CodeCompileUnit e)
at Microsoft.CSharp.CSharpCodeGenerator.System.CodeDom.Compiler.ICodeGenerator.GenerateCodeFromCompileUnit(CodeCompileUnit e, TextWriter w, CodeGeneratorOptions o)
at System.CodeDom.Compiler.CodeDomProvider.GenerateCodeFromCompileUnit(CodeCompileUnit compileUnit, TextWriter writer, CodeGeneratorOptions options)
at ArtOfTest.WebAii.Design.ProjectModel.Project.CreateElementsCodeFile(CodeDomProvider provider, Boolean& codeFileCreated, String& codeString, Exception& ex)
at ArtOfTest.WebAii.Design.ProjectModel.Project.RegenerateElementsCode()
I have a project configured to Run Locally and a scheduled test list for execution in the future. The error message appears also if you have scheduled a recurring test list.
When I make a change in any of the tests, that are part of the test list, I get the message "Storage service unreachable". My setup does not have an use a Storage service and the test is actually updated and executed as expected.
Please fix the cases when this message appears unnecessarily.
I created a Drag & Drop step from the Step Builder during test recording and picked a specific target element for the Drop location. The steps is created and executed correctly, but I am not able to copy or delete it.
I can disable it, so it does not execute, but it remains in the tests as a step.
On the Executive Dashboard, the columns are all fixed sized, the problem with this is that it gives very little space for test and test list names and makes it difficult to view the naming.
Please provide a way to resize or view the names easily.
1. Editing the newly created user profile. At the moment we rely explicitly on recording. There is no way to edit what you have recorded and make changes to the request.
- There should be way to copy paste requests.
- There should be way to create empty requests which you can then customize.
- There should be a way to use external data in the requests from a data store.
- There should be a way to reorder requests.
2. There should be an easy way to test your requests. At the moment there is no way to test how the recorded requests in the user profile perform.
The only way is to run a load test with a single user and record with fiddler. Then, in fiddler, I evaluate what was executed and then go back to the user profile editor and make changes. It should be done directly from the user profile editor.
When one schedules a test list and the tests execute with the rerun failed tests option, there is only a limited number of things that can happen.
1) a test may pass.
2) a test may fail once but pass the second time.
3) a test may fail twice.
4) a test may not run.
My suggestion is that, if these are the four types of result, report only this.
When you say this:
Run Summary: 25 of 25 test(s) run; 22 passed, 3 failed, 0 not run.
there is ambiguity. It is not clear what happened. It could instead say:
Run Summary: (#) test(s) run, (#) passed, (#) failed but then passed, (#) failed twice, (#) not run.
If the summary is in the second form, there is no ambiguity.
Why do some extract actions have expectation properties? Isn't the purpose of an extract just to get whatever value is set at the time and put it into a variable for later use (typically verification)?
For example, the RadDropDownList has the built in action of "Extract - RadDropDownList: all item count is '19'". This creates a step like this: "RadDropDownList('ctl00_cphM_ecAddContact_ddlCategory')Extract item count into DataBindVariable $(CphMEcAddContactDdlCategoryDiv)". The step properties have CompareType and ItemCount.
Interestingly, in my test of a drop down list with 19 items, I changed the ItemCount property to 999 and ran it and the step passed successfully.
It would be helpful extract the current selected value of a RadDropDownList, so it can be compared to the expected value. This is commonly used to verify if the selection was successful.
Please consider adding such extract steps for other similar controls.
Once you connect to a pop-up window, you can not switch back to the previous one, until the pop-up is closed. Some test scenarios will benefit from the possibility to switch back and forth.
Please consider this feature for next releases.
Both options to delete a cookie by domain and by cookie do not work for Chrome and Firefox. It still works for Internet Explorer though.
ActiveBrowser.Cookies.DeleteCookie(string domain);
ActiveBrowser.Cookies.DeleteCookie(Cookie cookie);
The ClearBrowserCache step is working as expected and clears all cookies.
Column name 'text (something' does not exist!
InnerException:
System.ArgumentException: Column name 'text (something' does not exist!
The Check for JS errors step is not working on remote execution with the Test Studio Test Runner. I have no issues when executing locally on the machine with Test Studio.
This is causing troubles for the CI builds and scheduled execution.