The chi-square test of independence is a statistical test used to determine whether two categorical variables are associated or independent. A way to assess the independence or dependence of variables is to use a contingency table, allowing you to compare the expected frequencies with the observed ones. In the realm of statistics, the chi-square test serves as a valuable tool across fields, such as marketing, social science, and medical research.
Inhaltsverzeichnis
- 1 Chi-Square Test of Independence – In a Nutshell
- 2 Definition: Chi-square test of independence
- 3 The chi-square test of independence hypotheses
- 4 When is the chi square test of independence used?
- 5 Calculating the test statistic of the chi-square of independence
- 6 Performing the chi square test of independence
- 7 Practice questions for the chi-square test of independence
- 8 Chi-square test of independence vs. other tests
- 9 FAQs
Chi-Square Test of Independence – In a Nutshell
- The chi-square test of independence determines if two categorical variables are related.
- With a contingency table the expected and observed frequencies can be compared.
- The null hypothesis assumes no relationship, while the alternative hypothesis does.
- The chi-square test of independence calculates the chi-square statistic.
- The p-value is then calculated and rejects or accepts the null hypothesis.
- The chi-square test of independence is a valuable tool among others, outlined in this article.
Definition: Chi-square test of independence
The chi-square test of independence is a statistical test used to determine the association between two categorical variables. The chi-square test of independence, also known as Pearson’s chi-square test, is a widely used nonparametric test because it does not rely on the assumptions of parametric tests, particularly the assumption of a normal distribution.
The chi-square test of independence is calculated by comparing the observed frequencies of categories in a contingency table with the frequencies that would be expected if the variables were independent. The components needed for the test are the observed frequencies, expected frequencies, and degrees of freedom.
Contingency tables
Contingency tables summarize and display the relationship between two categorical variables in the chi square test of independence. They are cross-tabulation tables, two-way frequency tables, or crosstabs.
They are useful for analyzing the relationship between two categorical variables, and they can be used as the basis for statistical tests such as the chi square test of independence.
Example
A contingency table could show the number of males and females who study psychology and those who take history.
The rows would represent gender (male and female), and the columns would represent study status (psychology and history).
| Gender | Psychology | History |
| Male | 67 | 130 |
| Female | 124 | 50 |
The chi-square test of independence hypotheses
The chi-square test of independence is used to test whether the observed frequencies of the categories in a contingency table differ significantly from those expected if the variables were independent.
Example
You can collect data on blood types from a sample of 500 individuals and create a contingency table with the observed frequencies. We then use the chi-square goodness of fit test to compare the observed frequencies with the expected frequencies based on the ABO blood type distribution in the general population.
The hypotheses for the chi-square goodness of fit test could be:
Example
Expectation of equal proportions:
- Null hypothesis (H0): The distribution of blood types in the population is consistent with the expected distribution.
- Alternative hypothesis (Ha): The distribution of blood types in the population significantly differs from the expected distribution.
Example
Expectation of different proportions:
- Null hypothesis (H0): The distribution of blood types in the population is consistent with the average distribution.
- Alternative hypothesis (Ha): The population’s blood types distribution significantly differs from the average distribution.
Expected values
Expected values in the context of the chi square test of independence refer to the frequencies that would be expected if the two categorical variables were independent.
The formula for calculating the expected frequency for each cell of a contingency table is:
Example
Consider a study on the relationship between education level and voting behavior. A researcher collects data from a sample of 500 individuals and records their education level (high school, college, graduate school) and voting behavior (voted, did not vote).
When is the chi square test of independence used?
The chi square test of independence can be used when certain criteria and circumstances are met:
- The variables under investigation are categorical or nominal
- The variables are independent of each other
- The expected frequency count for each cell in a contingency table is at least 5
If these criteria are met, the chi square test of independence can be used to test whether there is a significant association between the two categorical variables.
Example
You can use chi square test of independence to investigate the relationship between gender and religion.
Calculating the test statistic of the chi-square of independence
The formula for calculating the test statistic of the chi square test of independence is:
where
The chi-square test statistic measures the difference between the observed and expected frequencies in a contingency table.
To calculate the test statistic for the chi square test of independence, follow these five steps:
- Create a contingency table with the observed frequencies for the two categorical variables.
- Calculate the expected frequencies for each cell in the contingency table.
- Calculate the difference between each cell’s observed and expected frequencies, and square the difference.
- Divide the squared difference by the expected frequency for each cell.
- Sum the values obtained in step 4 to get the chi-square test statistic.
1. Table of frequencies
To conduct the chi square test of independence, the first step is to establish a contingency table containing the counts or frequencies of each category of one variable for each category of the other variable.
Example
We want to investigate the relationship between a new medical intervention and patient outcome. We collect data from 200 patients and record whether they received the intervention (yes or no) and had a positive outcome (yes or no). We create a contingency table for the chi square test of independence with the observed frequencies:
| Intervention | Outcome | Observed Frequencies |
| Yes | No | 60 |
| No | No | 40 |
| No | Yes | 30 |
| Yes | Yes | 104 |
2. Calculating O – E
This step of chi square test of independence helps to quantify the extent to which the observed frequencies differ from what would be expected under the assumption of independence between the two variables.
To calculate O – E, an additional column is added to the contingency table to represent the difference between the observed and expected frequencies for each cell.
Using the previous example of the medical intervention and patient outcome, the contingency table with added columns would be:
Example
| Intervention | Outcome | Observed Frequencies | Expected Frequencies | O - E |
| Yes | No | 60 | 50 | 10 |
| No | No | 40 | 50 | -10 |
| No | Yes | 30 | 70 | -40 |
| Yes | Yes | 10 | 30 | -20 |
3. Calculating (O – E)²
To calculate (O – E)², another column is added to the contingency table. This third step of calculating the chi square test of independence assesses the squared difference between each cell frequencies of observed and expected values.
Using the same example of the medical intervention and patient outcome, the contingency table with the additional columns would be:
Example
| Intervention | Outcome | Observed Frequencies | Expected Frequencies | O - E | (O - E)2 |
| Yes | No | 60 | 50 | 10 | 100 |
| No | No | 40 | 50 | -10 | 100 |
| No | Yes | 30 | 70 | -40 | 1600 |
| Yes | Yes | 10 | 30 | -20 | 400 |
4. Calculating (O – E)²/ E
To calculate , an additional column is added to the contingency table to represent the result of dividing the squared difference between the observed frequency and the expected frequency by the expected frequency for each cell.
Example
| Intervention | Outcome | Observed Frequencies | Expected Frequencies | O - E | (O - E)2 | |
| Yes | No | 60 | 50 | 10 | 100 | 2 |
| No | No | 40 | 50 | -10 | 100 | 2 |
| No | Yes | 30 | 70 | -40 | 1600 | 22.86 |
| Yes | Yes | 10 | 30 | -20 | 400 | 13.33 |
This step scales the contribution of each cell to the overall chi-square test statistic.
5. Calculating X²
The last step in the chi square test of independence is to sum the values in the column to obtain the overall chi-square test statistic. This test statistic measures the degree of association between the two categorical variables.
Continuing with the same example of the medical intervention and patient outcome in our chi square test of independence, we can sum the values in the column as follows:
Example
χ² = 2+2+22.86+13.33
χ² =40.19
Performing the chi square test of independence
When performing the chi square test of independence, a large value of the chi-square test statistic indicates that the observed frequencies in the contingency table are significantly different from the expected frequencies under the assumption of independence between the two categorical variables.
The six steps to perform the chi square test of independence are:
1. State the null and alternative hypotheses
2. Create a contingency table
3. Calculate the expected frequencies
4. Calculate the chi-square statistic using the formula:
5. Determine the degrees of freedom and p-value
6. Interpret the results association.
1. Calculating the expected frequencies
The first step in using the chi square test of independence is to calculate the expected frequencies for each cell in the contingency table. The formula for calculating the expected frequency for a cell is:
2. Calculating the chi-square
The second step of the chi square test of independence is to calculate the test statistic (χ²) using the formula: , where O is the observed frequency and E is the expected frequency.
where
3. The critical chi-square value
The critical chi-square value can be found in a chi-square distribution table or software, based on the chosen level of significance and the degrees of freedom (df). The formula for degrees of freedom for the chi square test of independence is:
where
The significance level is typically set at 0.05 or 0.01.
Example
In a 2×2 contingency table, the critical chi-square value with df=1 and α=0.05 is 3.84.
4. Comparing the chi-square value to the critical value
The next step in the chi square test of independence is to compare the calculated chi-square test statistic to the critical value obtained from the chi-square distribution table or software. If the calculated chi-square test statistic is greater than the critical value, the null hypothesis is rejected and it is concluded that there is a significant association between the two categorical variables.
5. Should the null hypothesis be rejected?
If the calculated chi-square test statistic is greater than the critical value, the null hypothesis is rejected, indicating a significant association between the two categorical variables. If the calculated chi-square test statistic is less than or equal to the critical value, the null hypothesis is not rejected, indicating no significant association between the two categorical variables.
Example
If the calculated chi-square test statistic is 10.26 and the critical chi-square value is 3.84, we would reject the null hypothesis and conclude that there is a significant association between the two variables.
Practice questions for the chi-square test of independence
How much knowledge do you have regarding the chi-square test of independence? The ideal and convenient method to find out how much you know is by asking yourself some practice questions for the chi-square test of independence. Therefore, the downloadable document below will explore some practice questions for the chi-square test of independence and their answers.
Chi-square test of independence vs. other tests
Apart from chi-square test of independence, some other tests in other scenarios include:
| Test | When to use it |
| Chi-square goodness of fit | When there is only one categorical variable and we want to test whether the observed frequencies fit a known or expected distribution. |
| Fisher’s exact test | When the sample size is small (typically less than 20) and the expected frequency for one or more cells is less than 5. |
| McNemar’s test | When the data are paired or matched, such as in a before-and-after study or a case-control study. |
| G test | When the sample size is small or the expected frequency for one or more cells is less than 5, and when the Chi-square test is not appropriate due to its assumptions. |
- ✓ 3D live preview of your individual configuration
- ✓ Free express delivery for every single purchase
- ✓ Top-notch bindings with customised embossing
FAQs
To perform a chi square test of independence in R, you can use the chisq.test() function, specifying the two categorical variables you want to test for independence. The function returns the test statistic, degrees of freedom, and p-value for the test.
A chi square test of independence is a statistical method used to determine if there is a significant association between two categorical variables.
To perform a chi square test of independence, the researcher creates a contingency table and calculates the chi-square statistic by comparing observed and expected frequencies.
The p-value is then calculated to determine if the null hypothesis is rejected or accepted in the chi square test of independence.
If the p-value is less than 0.05, the two variables have a significant association. If the p-value exceeds 0.05, there is no significant association. Another way, is to calculate the effect size, which can also determine the strength of the association.
