What Is a T Test? How to Read Results and Choose the Right Test

Statistics··13 min read

What Is a T Test

A t test, also written as t-test, compares the mean of a quantitative variable with a reference value or compares the means of two groups. In quantitative research, you will often use a t test to answer questions such as whether the mean satisfaction score differs from 3, whether men and women give different ratings, or whether scores changed before and after an intervention.

What does a t test mean as a statistical decision? The test begins with the null hypothesis, H0, that the mean difference of interest is 0, or that the sample mean equals a specified value. H1 states that a difference exists. You mainly evaluate the result through the p-value, which usually appears in SPSS as Sig. (2-tailed).

The t statistic is based on the difference between the observed mean and the value specified under H0, divided by the standard error of that difference:

t = (observed difference - difference under H0) / standard error

The exact formula changes according to the type of t test. With two independent groups, the standard error also depends on the variance and sample size of each group. Choose the correct test before you interpret the Sig. value.

If your goal is to test differences across more than two groups, a t test is no longer the appropriate choice. You can then refer to ANOVA, one factor ANOVA, or the guide to reading an ANOVA table.

Why the T Test Matters in Quantitative Research

A t test turns a descriptive observation into a tested conclusion. For example, the data may show that customers who have used an application have a mean satisfaction score of 3.8, while customers who have not used it have a score of 3.4. The 0.4-point difference is descriptive information. The t test tells you whether there is enough statistical evidence to conclude that the two groups differ in the population.

In a thesis, t tests usually appear in three places. The first is a one-sample test, where you compare a mean with a reference point such as 3 on a Likert scale. The second is an analysis of differences between two groups, such as gender, usage status, or customer type. The third is a repeated-measures study, where the same participant is measured at two time points.

You need to distinguish statistical significance from practical significance. A small p-value shows that the data provide evidence against H0. It does not by itself tell you whether the difference is large or useful in practice. Report the mean for each group, the standard deviation, the mean difference, and the p-value together.

The three common types of t test are:

  1. One-Sample T Test: compares the mean of one sample with a fixed value.
  2. Independent-Samples T Test: compares the means of two independent groups.
  3. Paired-Samples T Test: compares two measurements from the same participant or two matched observations.

For example, compare the satisfaction scores of men and women with an Independent-Samples T Test. Compare scores before and after training for the same 30 students with a Paired-Samples T Test. Compare the mean score of a scale with the value 3 using a One-Sample T Test.

If your grouping variable has three or more groups, do not split the analysis into multiple t tests without a clear reason. Repeating the test increases the risk of an incorrect conclusion because of multiple testing. Move to ANOVA and read the guide to t test procedures to check which situation applies.

What T Test Result Is Acceptable

The question “what t test value is good” usually mixes three ideas: the p-value, the t statistic, and the mean difference. The t statistic has no single fixed value that counts as good. It depends on the mean difference, dispersion, and sample size. In most theses, the decision about H0 is based on a preselected p-value threshold, commonly 0.05.

The table below summarises the main rules for reading the output. Each threshold is paired with a source so you can explain its basis if the committee asks.

What to readInterpretation ruleSource
Sig. (2-tailed) or p-valuep < 0.05: reject H0 at the 5% significance level; p ≥ 0.05: there is not enough evidence to reject H0(Field, 2013)
Significance levelChoose α before testing, with 0.05 commonly used in quantitative research(Field, 2013)
Independent Samples TestIf Levene's Test has Sig. > 0.05, read the Equal variances assumed row; if Sig. ≤ 0.05, read the Equal variances not assumed row(Field, 2013)
Durbin-Watson in a related regression modelA value from 1 to 3 is commonly considered appropriate when checking residual autocorrelation(Field, 2013)
Regression sample size with m independent variablesYou may use n ≥ 50 + 8m as a reference(Tabachnick and Fidell, 2013)

In the table, p < 0.05 is a decision rule, not a score that makes a t test good. If p = 0.001, the evidence against H0 is stronger than with p = 0.04, but both values pass the 0.05 threshold. Conversely, p = 0.08 does not allow you to write that the two groups are definitely identical. A careful statement is that there is not enough statistical evidence to conclude that a difference exists.

Levene's Test checks whether the variances of the two groups can be treated as equal. It is not the main test of a difference between means. Use Levene's Test only to select the correct row in the Independent Samples Test table, then read Sig. (2-tailed) from that row.

How to Read a T Test in SPSS Output

Suppose you want to compare satisfaction scores between male and female customers in SPSS. The dependent variable is SAT_MEAN, and the grouping variable is GENDER, where 1 represents men and 2 represents women. The table below is illustrative output, not the result of a real study.

SPSS tableGroup or statisticMeanStd. DeviationSig.
Group StatisticsMen, N = 1203.620.64
Group StatisticsWomen, N = 1383.810.59
Independent Samples Test, Levene's TestEqual variances assumed0.214
Independent Samples Test, t-test for Equality of MeansEqual variances assumedMean Difference = -0.190.011
Independent Samples Test, t-test for Equality of MeansEqual variances not assumedMean Difference = -0.190.012

Read the output in order rather than jumping directly to the p-value. First, check Group Statistics for the number of observations, mean, and standard deviation in each group. In this example, the mean for women is 0.19 points higher than the mean for men.

Next, check the Sig. column in Levene's Test for Equality of Variances. The value 0.214 is greater than 0.05, so you should read the Equal variances assumed row. In that row, Sig. (2-tailed) is 0.011, which is below 0.05. The illustrative conclusion is that the two groups differ significantly in their satisfaction scores.

Do not treat the 0.214 from Levene's Test as the p-value for your research question. This error is common when a student sees the first Sig. column and stops there. For a question about means, read the p-value from Sig. (2-tailed) in the t-test for Equality of Means section.

If SPSS shows Mean Difference = -0.19, the negative sign tells you the subtraction order from the first group to the second group. Return to Group Statistics to interpret the direction of the difference. In this example, the male group appears first, so men score 0.19 points lower than women.

For a One-Sample T Test, the table usually contains the columns t, df, Sig. (2-tailed), Mean Difference, and the confidence interval for the difference. For a Paired Samples Test, read the difference between the two measurements and the p-value for the pair. The table names differ, but the logic remains the same: identify H0, read the correct p-value, and combine it with the descriptive means.

What to Do When the T Test Is Not Significant

If the p-value is greater than or equal to 0.05, first check whether you selected the correct type of t test, the correct variables, and the correct group codes. A result that is not statistically significant does not automatically mean that the data are wrong. The observed difference may be small, the dispersion may be large, or the sample may not be large enough to detect the difference.

Work through the checks in this order:

  1. Check the coding of the grouping variable. For example, if gender is coded 1 and 2, make sure that values such as 0, 9, or text strings have not entered the analysis.
  2. Check the descriptive statistics, number of observations, and missing values. Very unequal group sizes or substantial missing data can make the result less stable.
  3. Check the relevant assumptions, especially outliers and the distribution of the quantitative variable. Do not delete an observation simply because it makes the p-value look better.
  4. Review how the variable was measured. If you entered individual Likert items into the t test instead of calculating the representative score specified by your model, the result may not answer your research question.
  5. If the two group variances are unequal, use the Equal variances not assumed row, which is usually the Welch result in SPSS, instead of forcing the variances to be treated as equal.

When the data strongly violate distributional assumptions or contain substantial outliers, you may consider an appropriate non-parametric test, but state the reason and selection process in the methods section. Changing the test simply because the t test did not produce p < 0.05 is difficult to defend.

You should also avoid deleting items, changing codes, or collecting additional data solely to obtain a smaller p-value. If the result is not statistically significant, report it accurately and explain it within the limits of your research design. The committee will usually ask about your procedure and the basis for your decisions rather than require every hypothesis to be accepted.

T Test, ANOVA, and Chi-Square Test

A t test and ANOVA can both compare groups, but a t test is appropriate when the grouping variable has two groups. ANOVA is used when there are three or more groups and the dependent variable is quantitative. When ANOVA is significant, you usually need a post-hoc test to identify which groups differ. You can also read what the chi-square test is when both of your variables are categorical.

MethodDependent variableGrouping or related variableAppropriate question
One-Sample T TestQuantitativeOne fixed valueDoes the sample mean differ from 3
Independent-Samples T TestQuantitativeTwo independent groupsDo men and women differ in satisfaction scores
Paired-Samples T TestQuantitativeTwo measurements from the same participantDid scores change before and after
One-Way ANOVAQuantitativeThree or more groupsDo three income groups have different means
Chi-Square TestCategoricalTwo categorical variablesIs gender related to purchase intention

The difference between an Independent-Samples T Test and a Paired-Samples T Test concerns the relationship between the two sets of observations. Men and women are independent groups. Before-and-after scores from the same person are paired data. Using an independent t test for before-and-after data ignores the relationship between the two measurements.

A t test also differs from regression. A t test answers a question about mean differences between one or two groups. Regression examines the effect of one or more independent variables on a dependent variable and can also control for other variables. Choose the method that matches the research question, rather than choosing the method based on an output table you already have.

Common Errors

The first error is calling every mean comparison a “t test” without specifying the type. In the methods chapter, write One-Sample T Test, Independent-Samples T Test, or Paired-Samples T Test clearly.

The second error is reporting only Sig. while leaving out the mean and standard deviation. The reader needs to know which group is higher, how large the difference is, and which output row supports the conclusion. A p-value does not replace descriptive statistics.

The third error is reading the wrong row because Levene's Test was skipped. Check Sig. of Levene's Test first, then select Equal variances assumed or Equal variances not assumed. If you use the wrong row, the conclusion can change when the group variances differ substantially.

The fourth error is writing “H0 is accepted” when p ≥ 0.05. A safer wording is “there is not enough evidence to reject H0.” The data do not show a statistically significant difference in the study sample, but they do not prove that the two populations are completely identical.

The fifth error is turning a quantitative variable into two groups simply to run a t test, even though the original question requires several levels or requires the continuous information to be retained. Splitting into groups can discard information and produce a conclusion that is difficult to explain. Review the model before changing the analysis.

Frequently asked questions

What is a t test and when do you use it?

A t test compares means. Use it when the dependent variable is quantitative and the research question concerns a reference value, two independent groups, or two measurements from the same participant.

What t test value is good?

There is no fixed t statistic that counts as good. At the 5% significance level, a p-value below 0.05 is commonly used as a basis for rejecting H0. You still need to report the mean, standard deviation, difference, and type of t test used.

Which row do you read for the Independent Sample T Test in SPSS?

First, check Sig. of Levene's Test. If this value is greater than 0.05, read the Equal variances assumed row. If it is less than or equal to 0.05, read the Equal variances not assumed row, then check Sig. (2-tailed) in the selected row.

Does a p-value above 0.05 mean that the data are wrong?

No. A p-value greater than or equal to 0.05 means that there is not enough evidence to reject H0 at the selected significance level. Check the coding, missing values, outliers, sample size, and choice of test before drawing a conclusion about data quality.

Should you use a t test when the grouping variable has three groups?

You should not use several separate t tests for three groups when your goal is to compare all groups. One-Way ANOVA is more appropriate for the overall test. If the result is significant, you can then consider a post-hoc test that matches the analysis design.

How do you write t test results in a thesis?

How to write this in your thesis

You can write: “The Independent-Samples T Test showed that the [dependent variable name] score for [group 1] was [Mean 1], lower or higher than the score for [group 2], which was [Mean 2]. This difference was [statistically significant/not statistically significant], t([df]) = [t value], p = [p-value].” Replace every bracketed placeholder with the actual values from your file and state which output row you used.

Open your SPSS file, identify the dependent variable and the number of groups, then select the correct type of t test, check Levene's Test, read Sig. (2-tailed), and save the output table together with the syntax. If you want to run the analysis on your own .sav or .csv file and turn the results into a table and the wording for Chapter 4, see DoThesis M4 data analysis.