Dashboard

Uploading Execution Reports to the Dashboard

As a new user, you will not see any execution reports in the Dashboard. You must have executed the script for a particular framework and generated a report using algoQA via the command prompt.

For example, if you have generated Java Selenium scripts and wish to upload the report to the Dashboard via the command prompt, run the following command:

java -jar algoQAUtil.jar -dashboard

Enter the Batch name and Test Suite name in the command prompt. You will be able to see the reports as described in the next section.

Using the Dashboard

The landing page of the dashboard is divided into two main sections: Test Execution Summary and Test Health.

Test Execution Summary includes:

• Total Test Case Execution Summary
• Total Tests Execution (Run) Duration
• Batch Execution Overview
• Failure Trends Over Time
• Test Suite Summary
• Test Suite Overview
• Batch Execution Summary

Test Health includes:

• Test Severity Distribution
• Test Health Score Distribution
• Test Health Summary

Dashboard Header

The dashboard header displays the selected project name, a notifications icon, filter and export buttons, as well as key metrics including total projects and total batches executed.

Selecting the Project

You can select the required project by clicking the Filter button. The filter panel provides several options:

• Date Selection Filter: Filter projects by date using predefined options such as Today, This Week, This Month, This Year, or a Custom Range.

• Project Selection Field: Search and select a specific project by typing its name.

After selecting your filters, click Apply to view the project details on the dashboard.

Additional options:

• Click Reset to clear all filters.
• Click Cancel to close the filter panel without applying changes.

Total Test Case Execution Summary

Located in the left pane of the dashboard under Test Execution Summary, the Total Test Case Execution Summary displays a pie chart that summarizes the total number of tests executed in the latest batch. The chart uses a color-coded scheme:

• Green: Passed test cases
• Red: Failed test cases
• Amber: Skipped test cases

Hovering over each color segment reveals a tooltip showing the exact number of test cases for that category.

Total Tests Execution (Run) Duration

Located in the right pane of the dashboard under Test Execution Summary, this section displays the total test execution time, the average time per batch execution, and the average time per test.

Batch Execution Overview

Located under the Total Test Case Execution Summary, this bar graph provides an overview of batch executions. You can filter the data by daily, weekly, monthly, yearly, or custom intervals. Hovering over each bar displays the number of batches, the number of runs in each batch, and the pass, fail, and skip counts.

Failure Trends Over Time

Located under Test Execution Summary, below the Total Tests Execution Duration, the Failure Trends Over Time graph displays Failure & Pass count and Failure Trend Rate in two different ways:

• Batch

• Days

  Click the More icon (three dots) to also view data by suite.

When Batch is selected:

• Failure & Pass Count is displayed as bars for the latest 7 batches.
• The failure trend graph for these batches is shown when you select Failure Trend Rate under Batch.

  

  

When Days is selected:

• Failure & Pass Count is displayed as bars, and you can view the data by weekly, monthly, and yearly intervals.
• The Failure Trend graph is displayed when you select Failure Trend Rate under Days.

  

  

Test Suite Summary

Located under Test Execution Summary, below the Batch Execution Overview. Click the More icon (three dots) to select a test suite. This view displays the pass rate and fail rate, the number of tests passed, failed, and skipped, the total tests executed, and the duration of execution.

Test Suite Overview

Located under Test Execution Summary, below the Failure Trends Over Time section, this section displays the total number of runs from each suite, pass rate (%), execution duration, and severity level for each test suite.

Batch Execution Summary

Test cases executed in batches are displayed in a tabular format. Each line item includes:

• Batch Name: The name assigned to the batch execution.
• Batch ID: A unique identifier for the generated report.
• Test Suite: The name of the test suite.
• Executed By: The name of the person who executed the test case.
• Start Date and End Date: The date range of the test execution.
• Duration: The time taken to execute the test cases, in seconds.
• Test Runs: The number of test runs in the batch.
• Pass, Fail, Skip: The count of passed, failed, and skipped test runs.

Use the pagination option to navigate through multiple pages of results. If test cases were executed in batches, those files are combined under the same tags. These combined line items cannot be deleted; they can only be downloaded. Individual batch files can be both deleted and downloaded. Perform these actions by selecting the More Menu (three dots) option in the Action column.

View and download individual reports in HTML format by selecting View Report.html or Download Report from the More menu (three dots) in the Action column.

Search for particular batch execution details by providing the required Batch Name, Batch ID, and Executed By options. Click a batch to view the Total Unique Test Case Execution Summary, Failure Analysis Summary, Auto-Healing Insights, Failure Analysis, All Test Executions, Failure Executions, and Slowest Executions.

Total Unique Test Case Execution Summary

You can view:

• Pass Rate (%): The percentage of test cases that passed.
• Execution Results: The number of test cases that Passed, Failed, or Skipped.
• Total Unique Test Cases Executed: The total number of unique test cases that were executed.

Failure Analysis Summary

This section displays the number of test cases that failed in each category within a batch.

Auto-Healing Insights

This section displays Auto-Healing accuracy in percentage, number of steps analyzed, number of steps passed and failed, Total AutoHeal Test Case, and manual review needed.

Click View AutoHeal Details to open the All TestCases table, which shows Scenario Id under Test Case Name, Tags used in the Test case, Total AutoHealed Steps, and Status.

Click the dropdown icon beside the test cases to view Auto-Healed Steps Start Time and End Time, followed by a table with all the Steps, Original XPath, Auto-Healed XPath, and Status.

Failure Analysis

This section displays the details of each test case within the selected batch. Failed test cases are grouped by failure category and listed in the Category List. Selecting a category displays all failed test cases associated with that category.

You can also edit a category name if it is not relevant by clicking the Edit icon next to the category. If a test case requires a new category, click the More icon (three dots) and add a new category for that test case.

Click a test case to view the failure reason, number of test runs, and details such as scenario name, tags, and scenario outline. You can also use the Filter option to filter test cases by failure reason. If a test case has multiple failure reasons, all applicable reasons will be displayed.

Click a failure reason to display the corresponding test case ID. Selecting the test case ID shows the detailed failure reason, along with an option to add suggestions.

All Test Executions

This section displays all the test executions under the selected batch.

Click the down arrow of a test case to view the result of every run of that particular test case, see the reason for any failures, and provide suggestions if needed.

Failure Executions

This section displays the failed test executions under the selected batch.

Slowest Executions

This section displays the slowest test executions under the selected batch.

You can use the expand arrow to enlarge the table for a better view, which will hide the Total Unique Test Case Execution Summary and Failure Analysis Summary. Click the collapse arrow to view the summaries again.

Exporting Failure Analysis

An Export option is available for Failure Analysis in the top-right corner. The details of the selected batch can be exported in Excel or HTML format.

• HTML Export: By default, Charts & Graphs, All Test Executions, and Failure Analysis are selected.
• Additional Options: You can also choose Failure Executions and Slowest Executions.

Select or deselect the desired options and click Download to export.

Test Severity Distribution

Located under Test Health in the left pane, this section displays the severity distribution, showing the tests categorized as Critical, High, Medium, Low, and Minimal. Severity measures how reliable and stable the test executions are, based on test outcomes and overall health patterns. Hovering over each category shows the number of scenarios and percentage of that particular category. You can also view them in different types of graphs such as polar, bar, line, and doughnut graphs by clicking the graph selector.

Test Health Score Distribution

Located under Test Health in the right pane, this section displays the overall test health score, categorized as Excellent, Good, Moderate, Poor, and Critical. Health Score shows how stable and reliable the test results are over time. Hovering over each category shows the number of scenarios and percentage of that particular category. You can also view them in different types of graphs such as radar, bar, line, and pie graphs by clicking the graph selector.

Test Health Summary

Located under Test Health, below the Test Severity Distribution, you can view detailed test case information. Using the dropdown, you can select either Severity or Health Score to see the number of test cases that fall within the defined ranges.

You can also view the total number of test cases, total batches, and total duration.

This table is grouped by scenario name and displays the scenario name, component, number of passed, failed, and skipped batches, failure rate (percentage), duration, health score (percentage), severity, last failure date, and defect ID. You can also search the scenarios using the search field. A filter option is available to filter by suite.

Click a scenario name to view all batches containing that scenario, along with details such as Batch Name, Batch ID, User Name, Test Suite, Test Runs, Status, and Run duration. Above this table, you can also view Scenario Name, Total Batches, Total Test Runs, Total Duration, and Failure Rate.

Click a batch name to view test runs of that scenario under the selected batch, including status, duration, start date and time, end date and time, and comments for each run.

Click a failed result to view the failure reason along with a screenshot of the failure and add your suggestions.

Exporting the Report

You can export the report by clicking the Export Report button in the top-right corner. You can download the results in the CSV, Excel, or HTML format. Select the required options from the Batch Execution Summary or Batch Execution Result sections. Note that you will not be able to uncheck the Batch Name option.