Examining significance test
results
Learn about how significance test results are displayed and how to identify significant segments.
When significance testing is applied to a question, the report tile is updated to display the significant test results in the crosstab, and a new Significant Differences panel is added below the crosstab.
| Number | Description |
|---|---|
| 1 |
Each banner column is assigned a letter. This letter is used to identify the banner in the crosstab and in the Significant Differences report below the crosstab. 
If nested banners are applied to the report, the letters are assigned at the lowest level of nesting. If more columns are included than letters in the alphabet, the columns are labeled A-Z and then AA-ZZ, AAA-ZZZ, etc. |
| 2 | In the crosstab, each cell that is significantly higher than another cell, or multiple cells, is highlighted in light green. The letters representing the cell(s) the current cell is higher than are listed below the cell value. The "Canada (A) - Average" and "Mexico (C) - Average" cells are both significantly higher than the "US (B) - Average" cell. |
| 3 | The Significance Testing field lists the paired tests performed. A/B/C means that a series of tests were performed comparing A to B, A to C, and B to C. |
| 4 | The bulleted list provides a text-based explanation for each of the results highlighted visually in the crosstab. |
When you hover your mouse over the identifying letter where a significant difference has been identified, you can view details about the test performed and the results.
- The title of the pop-up displays the details for the significant result that was found. In this example, the value for the highlighted C cell (5.67) is significantly higher than the B cell value (4.53).
- The Test field lists the specific significance test that was performed.
- The Confidence Level field indicates the confidence level in effect when the test was performed. The default is 95%, but you can configure this value in the Significance Testing page.
- The P-value field lists the p-value calculated for the test, or "< 0.05" if the p-value is less than 0.05. In this example, the p-value was less than 0.05, which confirms that the result is significant.