Test execution is managed with test runs. A test run is a snapshot of your project that includes all the tests or just a subset of them. A test run creates a kind of branch of the project where current definitions of tests are stored. It means that you can continue working on your scenarios and modify them without impacting the test run and the execution. Of course your can synchronize your test run at any time with the new definitions of scenarios.
For each test of a test run, you can add one or more test results to keep track of your test execution progress.
Create a test run
When creating a new test run, you can choose between 3 options:
- include all the tests,
- select the same tests as a previous test run,
- select a subset of tests (you can filter by folders and scenarios),
- create an empty test run that will be used to integrate external test results.
Then click Create button at the bottom of the page.
Once your test run is created you can see the list of tests and metrics. Click this button to switch between folder view and list of tests.
From this page, you can:
- select a test for execution,
- synchronize all the tests with the latest definitions of scenarios,
- delete the test run,
- archive the test run,
- export the data into an excel file.
If the test run contains many execution cycles, you can see the history by clicking on the ‘Execution history’ tab:
Assign a test to a user
You can assign a test to a user in the “Assignees” section. This user should be a project member.
Execute a test manually
When selecting a test, you can add one (or many) execution result. An execution result contains a description, a date, the author of the execution and the status. The author is automatically updated. You can add a description and attach files to an execution result (screenshot…).
You can also track execution step by step. The first click marks the step as passed, the second one as failed and last one as undefined.
In one click you can also set your test as passed and go directly to the next test.
In two clicks you can choose a new status and go to the next test.
Below the execution results, you have access to the execution results history:
From the test page you can as well:
- add tags to your test
- assign the test to one or many project members
To see how to automate your tests and link Hiptest to your continuous integration server see the “Automate your tests” section.
Test run Metrics
At any time you can click on the test run name (left column) to view the metrics. You can also export test runs into an excel file and then customize your metrics.
You can go back to your list of test runs by clicking on the test run menu. From this test run list, you can export the content of all your test runs into a single excel file (1 test run by tab) and customize your metrics., and do actions on the existing test runs.
Add a new scenario to a test run
You can add a new scenario to a test run directly from the scenario page via the “Add to test run” button.
Or you can add many scenarios from the folder page. Just select your scenarios and click on the button “Add to test run”.
Archive test runs
Because your test runs list can grow very quickly, you can hide some of your test runs from it, thanks to the “Archive” button.
You can find archived test runs in your test runs list by selecting the dedicated filter.
An archived test run will not appear in the test results list of a scenario, nor you will be able to add a scenario in it or watch its metrics on the project dashboard. To unarchive a test run, click on the “Unarchive” button on its page.