Duplicated
Last Updated: 06 Jul 2020 15:07 by ADMIN
Daniela
Created on: 01 Jul 2020 07:49
Type: Feature Request
1
API testing with CI // support human-readable format

When it comes to automated testing of the API, it would be useful to support human-readable (markdown/html/pdf) formats.

 

We (dev & qa team) want to use the generated output file as documentation to make the test cases & results easily accessible for the product manager and colleagues without licensed access. The supported xml file already contains a lot of information about the tests.

The human-readable version does not need to be multilingual, English is perfectly sufficient. The format only needs a standard like markdown, html or pdf.

 

We would need something like that: 
C:\>"C:\Program Files\Telerik\Test Studio for APIs\Bin\ApiTesting\runnerconsole\Telerik.ApiTesting.Runner.exe" test -p "C:\DemoTests" -o "C:\result.md" -f markdown

Duplicated
This item is a duplicate of an already existing item. You can find the original item here:
3 comments
ADMIN
Elena
Posted on: 06 Jul 2020 15:07

Hi Daniela,

I am sorry to know you encountered any troubles with the suggested option to output the results in other format. It seems that I have misled you in my reply as the format, which can suit your needs better in the current implementation is the junit one. This is to be triggered with -f junit parameter in the API testing runner. Please, give it a try and check if it will provide some additional details, which will be beneficial for you. 

Apart from this, the junitstep is also a possible format, but it seems there is something wrong with it - I tested it on my end as well and got the same message. Thus, I logged a bug report on your behalf to our feedback portal and will pass the item internally to the development team.

As a summary: there is a feature request logged in regards the need of outputting the results in different format - this can be followed here. And since we identified an error with the junitstep format, there is a bug report on the case - the item to follow on this topic is listed here. Both items are internally disclosed to the development team and will be evaluated further. 

Thank you for your cooperation once again.

Regards,
Elena
Progress Telerik

Progress is here for your business, like always. Read more about the measures we are taking to ensure business continuity and help fight the COVID-19 pandemic.
Our thoughts here at Progress are with those affected by the outbreak.
Daniela
Posted on: 03 Jul 2020 12:26

Hello, Elena,

thanks for your hint the format junitstep. 

Unfortunately I could not execute it right now. Is it because of the test version of Telerik.ApiTesting.Runner.exe or is it a typo? 
This is what I get:

C>"C:\Program Files (x86)\...\Telerik.ApiTesting.Runner.exe" test -p "C:\Git\..\telerik" -o C:\tmp\result.xml -f junitstep 

13:13:14.926 [ERROR] Not supported test results format
Parametername: junitstep

Perhaps you can provide me with an example for now?


Our goal is to see the linked test case with the individual steps (and the last result) from the Scrumboard/Story. We would like to visualize this information even more if possible. At JUnit I had no deep insight, as far as I know it is a Java testing framework. Maybe there is already a viewer or ways to display the xml of junitstep in a user friendly way/webpage.

From your point of view, what would be the recommended way?  The test studio for UI has many export possibilities of steps/result. We would also like to have this for the API test cases. 

Thanks for your support and best regards


ADMIN
Elena
Posted on: 02 Jul 2020 15:18

Hi Daniela,

This request seems to be duplicating another one you recently posted - you can find it listed here. Thus, I will proceed closing this one as a duplicate one. Please, use the shared item to follow its progress and add further notes, if necessary. 

As a side note here I wanted to mention that you can give a try to the junitstep formatting  (-f junitstep)for the results and check if these display further information helpful for you. 

Please, do not hesitate to continue the discussion if there is something I have missed. Thank you in advance for your understanding. 

Regards,
Elena
Progress Telerik

Progress is here for your business, like always. Read more about the measures we are taking to ensure business continuity and help fight the COVID-19 pandemic.
Our thoughts here at Progress are with those affected by the outbreak.