Progress® Telerik® Test Studio® Feedback Portal
Back to Feed
Request a Feature Report a Bug
Completed
Last Updated: 15 Sep 2020 20:38 by ADMIN
Ewin
Created on: 30 Sep 2014 19:28
Type: Feature Request
1
usability with test studio
I have been using test studio for 3 years.  

I allow these constant gripes with test studio.  

As shown in this 1st screencast link, you will see that after I click Execute, Test Studio takes me to the bottom of the test instead of leaving where the test was at the time I click Execute.  

As shown in the 2nd screencast, you will see that I go to my Results.  The testlist results is not leaving me at the point when I left the Result page.  The Results constantly reloads unnecessarily even when the results were loaded the first time. It is so frustrating to wait for the results have to load over and over without reason. 

Each test studio project has a setting.aiis file as if it was a solution file from visual studio.  Allow users to open test studio projects directly from file and not needed to go through the process of launching test studio and then select the project to open. 

With the Multiple Test being opened, there is a limitation with the current build.  There appears to be only 1 Execute option when dealing with multiple test at the same time.  Each opened test should have its own option to execute and not be hinder by other opened tests. Like shown in 3rd screencast link.  

There is Base URL.  There are 3 distinct locations for baseurl.  WHY?  The Project BaseURL seems get overridden when attempting to use the BaseURL within a test's navigate step or within a test list's setting.  Drop the unnecessary BASEURL. Shown in 4th screencast.

After opening the Test Studio Project and click Test List, why does it take a while to actually load all the test lists?  The test lists are not more than query based references to specific tests in the project. I noticed that at the bottom on the page, there is a note of Extracting Element from Tests shown in 5th screencast.  Break this dependency and improve the load time of the test lists.  

In the 6th screencast, there appears to be unnecessary whitespace.  In a previous feedback item, I suggested this: http://feedback.telerik.com/Project/161/Feedback/Details/137316-customize-location-of-menu

I also have another feedback item: 
http://feedback.telerik.com/Project/161/Feedback/lo[o/137289-closing-multiple-tests

Last item on my rant is this feedback item: 
http://feedback.telerik.com/Project/161/Feedback/Details/133771-while-loop-count-for-coded-step
2 steps versus 12 steps for a while loop.

http://screencast.com/t/q8icfzpyW
http://screencast.com/t/UMgggyYgP
http://screencast.com/t/2ZwT9eM8HD
http://screencast.com/t/sWLhIvTwqiax
http://screencast.com/t/0ecaFaD0gb
http://screencast.com/t/BdnGaSnR
22 comments
Ewin
Posted on: 02 Oct 2014 13:23 
@Daniel D, question about being connected to TFS. 

Results are really tedious and cumbersome to allow them to go to TFS consider my projects size.  

Do the results try to load from TFS like you stated for the test lists?  Even though the results only exist locally?
ADMIN
Daniel Djambov
Posted on: 02 Oct 2014 07:29 
Telerik: @Hong regarding issue 7 - I have filed a Feature Request with your proposal  - you can track it from here http://feedback.telerik.com/Project/161/Feedback/Details/139195-better-usage-and-customization-of-test-view-options-to-hide-and-move-panels
ADMIN
Daniel Djambov
Posted on: 02 Oct 2014 07:23 
Telerik: @Hong regarding issue 6 - from what I see in the screencast, the project is TFS connected and no matter if you open it from Open TFS or open it locally, but from the local TFS mapped location (this is important and is your case) - we detect that the project is TFS connected and we try to connect and communicate with TFS server to get data about Tests and Test Lists.
ADMIN
Daniel Djambov
Posted on: 02 Oct 2014 07:16 
Telerik: @Hong regarding issue 5 - the project setting in Recording Options about BaseURL should be filled and used when you want the navigate steps recorded to be automatically configured for using BaseURL. Now that I look at the 3 comments I have written to explain the BaseURL usage it is clear that indeed documentation should be updated and be more clear - I have filed a request to update it.
ADMIN
Daniel Djambov
Posted on: 02 Oct 2014 06:47 
Telerik: @Hong regarding issue 5 - About your specific question in your setup - if you only need to perform a quick check on single or few tests against your QA or Dev environment, you can change the BaseURL on test level directly and run from Quick Execute. If you need to run a test list against QA or Dev environment, then you change the base URL in Test List Settings and execute the list. You can create 2 test lists with the same set of tests, first list to have a BaseURL against your QA environment, second test lists with BaseURL against your Dev environment - that way it will be more clear when analyzing the results which run was against which environment (based on Test List name).
ADMIN
Daniel Djambov
Posted on: 02 Oct 2014 06:41 
Telerik: @Hong regarding issue 5 - there is documentation available about BaseURL (http://docs.telerik.com/teststudio/user-guide/knowledge-base/test-execution/using-baseurl.aspx) - we can revise it and be more specific in describing the differences there.  About
ADMIN
Daniel Djambov
Posted on: 02 Oct 2014 06:35 
Telerik: @Hong about issue 4: we have ensured that when one test is running, other tests cannot be run, either from the Ribbon bar Run button or from Project explorer context menu - Run option should be disabled. If in some case it is not - this is a bug - we will try to replicate such situation.
As per the suggestion of Daniel L - I have files a Feature Request to improve the visibility of which test is currently being executed, so it is more clear: http://feedback.telerik.com/Project/161/Feedback/Details/139189-improve-usability-to-better-show-which-test-is-quick-executing-when-multiple-test
ADMIN
Daniel Djambov
Posted on: 02 Oct 2014 06:27 
Telerik: @Hong: thank you once again for the additional comments - these are extremely helpful from such valuable customers as you are!
Ewin
Posted on: 01 Oct 2014 13:48 
@Daniel D, for the #7,

Like my feedback item about customizing locations of menus, I provided a screenshot of what my layout is for Visual Studio.  

In test studio, the Project and Element tabs are unrelated tabs to be bundled together on the left hand side.  The Element and Step Suggestion are closely related to each other.  The property tab does not need to be the full right side.  Allow the property tab to be half of a particular side and make it scrollable.  

Additionally, I did not think about this for the feedback item, allow the user to hide a particular tab that is not needed and have ability to toggle it on and off.  The step suggestion might not be necessary to show all of time
Attached Files:
Ewin
Posted on: 01 Oct 2014 13:31 
@Daniel D, regarding your comment on issue 6, 

A side note: Test Studio does not show if the test list is edited or matching tfs.  

In my particular case, I open my project locally.  So are you saying that TFS is confirming my local file test list is the same as the TFS test lists or are they actually getting redownloaded from TFS even though they exist locally?
Ewin
Posted on: 01 Oct 2014 13:23 
@Daniel D, regarding your comment on Issue 5, 

With your explanation, I understand better.  

With that in mind, I would request a KB to describe the differences of the Base URL. 

My scenario for automated test is that I record on a QA environment.  The QA environment stays in always able to be returned to a particular state for tests.  There are some times where I would check the test in dev environment or even run directly off my machine due to speed or check against environmental differences.  

So with my described scenario, should I update the BaseURL in the test's step or at the project setting level?
Ewin
Posted on: 01 Oct 2014 13:12 
@Daniel D, regarding your comment on issue 4: 

There have been occasions where the execute did not return when running one test while multiple tests were opened.  When that happened, I was able to Run Test by locating the test in the project and right clicked on it to then select Run Test from there.  It has happened several times.  I will try to capture it if I encounter it again.
Ewin
Posted on: 01 Oct 2014 13:05 
@Daniel L, it would help some.
ADMIN
Daniel Levy
Posted on: 01 Oct 2014 12:51 
Regarding Issue # 4 - would it help if we indicated which test was executing in the tab?
ADMIN
Daniel Djambov
Posted on: 01 Oct 2014 12:30 
Proposal 7: the white space is indeed a big stop in some cases as you have shown, but there are many other steps which properties fill almost the whole area. We will pass your feedback to the Product Management and UX team to consider better usage of the space.
ADMIN
Daniel Djambov
Posted on: 01 Oct 2014 12:28 
Issue 6: why it takes initially time to show Test Lists after opening a project - actually this is not the case. The actual issue is that the project is TFS connected and Test Lists are being downloaded from TFS, that is why the UI is not responsive. The status that says "Extracting Elements ..." is a side effect from the UI freeze, where the element extraction operation was cancelled when navigating to Test Lists. I have filed a feedback about implementing a progress indicator in this case - you can follow it from here: http://feedback.telerik.com/Project/161/Feedback/Details/139141-implement-progress-indication-for-tfs-connected-projects-when-trying-to-get-data
ADMIN
Daniel Djambov
Posted on: 01 Oct 2014 12:09 
Issue 5: Base URL options being located on 3 different places is confusing to the user. Actually there might be a little misunderstanding about it, let me try to explain. The Project Settings option for Base URL is ONLY used for Recording (it is in the Recording section). So there are 2 places left for BaseURL to be used  - on a Test level and Test List level. The idea is the following - when creating a Test, to use a Test WebSite during Test creation and debugging. Once the Test is ready you put it in a Test List, from which if you want to test the Test WebSite you will not change anything in Test List settings, just run the Test List. Now once the WebSite goes to production, or you want to test several versions of the WebSite on different servers with the same test, you change the Test List Settings to use a NEW Base URL for the new site and this will overwrite the Test BaseURL property only in this case. If there is some use case that we are missing in this situation, please let us know to consider.
ADMIN
Daniel Djambov
Posted on: 01 Oct 2014 12:09 
Issue 4: when Multiple tests are opened in Test Explorer, there is a single Execution option available - it is not very clear what is expected here. There can and should be only 1 test run at a time for various reasons, so if you start a Quick Run one test, Execution should be disabled for all other tests. The only usability issue that can be considered in this case is to be able to Stop the execution from any opened test (which now shows Stop button disabled) , not only from the currently running test.
ADMIN
Daniel Djambov
Posted on: 01 Oct 2014 11:51 
Proposal 3: opening a project directly by double-clicking on the Settings.aiis file - I have added a new Feature Request about it http://feedback.telerik.com/Project/161/Feedback/Details/139134-open-test-studio-project-by-selecting-the-settings-aiis-file-from-windows-explore
ADMIN
Daniel Djambov
Posted on: 01 Oct 2014 11:42 
PRoblem2: there is already a Feedback about this behavior - you can follow it from here http://feedback.telerik.com/Project/161/Feedback/Details/125693-persistent-results-tab-view
ADMIN
Daniel Djambov
Posted on: 01 Oct 2014 11:38 
Problem1: here is the link to 1st mentioned problem about Scrolling in Test Explorer - you can follow it from here directly http://feedback.telerik.com/Project/161/Feedback/Details/139132-test-explorer-scrolls-always-to-recording-marker-and-makes-bad-usability-for-test
ADMIN
Daniel Djambov
Posted on: 01 Oct 2014 11:36 
Telerik: thank you for the valuable feedback - we will process it in a timely manner and take into consideration in our next releases
Create an account Log In
View
Type
Status