Analyzing test run results

After you run the tests, you can view the test run results on the Results page in HCL OneTest™ Server. You can change the display of the columns for the items you want to view. You can search and filter the results for specific criteria. You can also compare reports and view the trending report for certain tests.

Overview

The Results page provides you with a comprehensive view of all the results of the tests that were run in the project.

Image of the results page

Changing attributes in columns

The results are presented in a tabular view with the tests results displayed in rows and the different attributes of the tests that ran displayed in columns. You can choose to display any or all the attributes in columns by clicking the Settings icon image of the settings icon. You can select from the following attributes to display their values in columns:
  • Id
  • Type
  • Test
  • Result
  • Started By
  • Started On
    Note: You can select a relative time period for the tests run by selecting the Relative Date check box.
  • Finish On
  • Duration
  • Status
  • Verdict
  • Labels

Sorting column values

You can sort the items in any column in an ascending or descending order by clicking the column header.

Pagination

In the Results page, you can navigate between pages and change the number of results displayed per page by using the Pagination box at the bottom of the page. The number of results per page can be changed to a different value. You can use the Pagination box to navigate to the First page (Image of the first page icon.), Previous page (Image of the previous page icon.), Next page (Image of the next page icon.), or the Last page (Image of the last page icon.).

Searching results

You can use the search option in the Results page to search for any value in the following columns Test, Result, and Verdict. Use the Search box to enter the criteria to search. The search option filters and displays the results that match your search criteria.

Filtering results

You can filter results based on a predefined time period, for example, last 24 hours by selecting the interval from the list.

You can filter results from a custom date range by selecting the From and To dates in the Results page.

You can filter the displayed results to display results based on the verdict by clicking the Verdict Summary bar. You can select results to filter and display any of the following verdicts: Pass, Fail, Inconclusive, or Error. The selected verdict is displayed at the top of the results table as a filter applied. See the following image that shows the verdict Pass selected as the filter and is displayed on top of the results table.

Creating filter queries

You can create queries to filter results.

  1. Create a New filter from the Results page.
  2. You can create a query by using either the AND or the OR operator.
  3. You can add a rule in your query or add a group.
    Note: A group is a collection of rules and can also contain other groups within a query.
  4. You can use the operator and add a rule or a group within a group in the query.

Adding a rule

  1. Select the operator, And or Or.
  2. Select Add Rule.
  3. Select the first attribute you want to query.
  4. Select the condition as equal to (=) or not equal to (!=).
  5. Select from the options displayed for the selected attribute. For example, select from the options displayed for the attribute Type.
  6. Apply the rule.
    Note: You can sort the results based on any column header in an ascending or descending order that you want and then save the filter query. The order in which the results are sorted is also saved in the filter query. When you apply the saved filter, the sorting order of the results saved is reapplied to the filtered results.
  7. Save the filter by entering a name for the filter in the dialog box that is displayed when you close the filter.
  8. The applied filter that is saved shows up as a filter above the results table.

Adding a group

  1. Select the operator, And or Or.
  2. Select Add Group.
  3. You can add a rule or a group within this group. To add a rule, follow the steps to add a rule.
  4. You can add rules in the group or rules in the parent group depending on the criteria you want in your query.
  5. Apply the rule.
    Note: You can sort the results based on any column header in an ascending or descending order that you want and then save the filter query. The order in which the results are sorted is also saved in the filter query. When you apply the saved filter, the sorting order of the results saved is reapplied to the filtered results.
  6. Save the filter by entering a name for the filter in the dialog box that is displayed when you close the filter.
  7. The applied filter that is saved is displayed as a filter above the results table.

Applying saved filters

You can apply your favorite filters that you have saved on the results in the Results page.

  1. You can apply the filter from the list of saved filters by using the Image of the filter icon. icon.
  2. Select the filters from the list of saved filters.

The selected filter is applied and the filtered results are displayed.

Deleting results

You can delete results from the Results page to remove the results from the display.

  1. Select the results you want to delete or remove them from the Results page by checking the box in the first column.
  2. Delete the selected results by clicking the Delete icon Image of the delete icon.. The selected results are deleted and removed from the results displayed in the Results page.
Note: The results deleted for tests run can be displayed in the Results page after you run those tests again from the Execution page.

Locking and unlocking results

You can lock or unlock the test results displayed in the Results page. You can opt to lock results for tests that you consider significant. For example, at the end of a release you might want to retain these results and would not want them to be deleted. Locked results cannot be deleted by other members of your project. You can unlock the results at any time after locking.
  • To lock results, go to Step 1.
  • To unlock results, go to Step 3.
  1. Select the results you want to lock in the Results page by selecting the check box in the first column.
  2. Lock the selected results by using the Lock icon Image of the lock icon.. A message is displayed for a successful lock operation. After a page refresh, the locked results are displayed with a lock icon in the result row.
    Note: Only the member who locked the results can unlock the results. The project owner can unlock results locked by other members in the project.
  3. To unlock the results, select the locked results that you want to unlock from the locked results.
  4. Unlock the selected results by using the Unlock icon Image of the lock icon.. A message is displayed for a successful unlock operation. After a page refresh, the results are unlocked and the lock icon removed from the result row.

Comparing reports

You can compare the test reports for two or more tests.

  1. Select the results you want to compare the reports in the Results page by checking the boxes in the first column.
  2. Compare the reports by using the Image of the compare reports icon. icon.

The selected report is displayed in a browser window and you can compare the reports.

Image of the compare report.

Viewing trending reports

You can view the trending test reports for two or more tests.

  1. Select the results you want to view the trending reports in the Results page by checking the boxes in the first column.
  2. View the trending reports by using the Image of the compare reports icon. icon.

The trending report of the selected reports is displayed in a browser window and you can view the report.

Image of the trending report.

Feedback