Statistics Tutorial: Difference Between Proportions

Many statistical applications involve comparisons between two independent sample proportions.

Difference Between Proportions: Theory

Suppose we have two populations with proportions equal to P₁ and P₂. Suppose further that we take all possible samples of size n₁ and n₂. And finally, suppose that the following assumptions are valid.

• The size of each population is large relative to the sample drawn from the population. That is, N₁ is large relative to n₁, and N₂ is large relative to n₂. (In this context, populations are considered to be large if they are at least 10 times bigger than their sample.)
• The samples from each population are big enough to justify using a normal distribution to model differences between proportions. The sample sizes will be big enough when the following conditions are met: n₁P₁ > 10, n₁(1 -P₁) > 10, n₂P₂ > 10, and n₂(1 - P₂) > 10.
• The samples are independent; that is, observations in population 1 are not affected by observations in population 2, and vice versa.

Given these assumptions, we know the following.

• The set of differences between sample proportions will be normally distributed. We know this from the central limit theorem.
• The expected value of the difference between all possible sample proportions is equal to the difference between population proportions. Thus, E(p₁ - p₂) = P₁ - P₂.
• The standard deviation of the difference between sample proportions (σ_d) is approximately equal to:
  
  σ_d = sqrt{ [P₁(1 - P₁) / n₁] + [P₂(1 - P₂) / n₂] }

It is straightforward to derive the last bullet point, based on material covered in previous lessons. The derivation starts with a recognition that the variance of the difference between independent random variables is equal to the sum of the individual variances. Thus,

σ²_d = σ²_{P1 - P2} = σ²₁ + σ²₂

If the populations N₁ and N₂ are both large relative to n₁ and n₂, respectively, then

σ²₁ = P₁(1 - P₁) / n₁       And       σ²₂ = P₂(1 - P₂) / n₂

Therefore,

σ²_d = [ P₁(1 - P₁) / n₁ ] + [ P₂(1 - P₂) / n₂ ]       And       σ_d = sqrt{ [ P₁(1 - P₁) / n₁ ] + [ P₂(1 - P₂) / n₂ ] }

Difference Between Proportions: Sample Problem

In this section, we work through a sample problem to show how to apply the theory presented above. The approach presented is valid whenever we need to analyze differences between independent sample proportions. In this example, differences between proportions are modeled with a normal distribution; so we use Stat Trek's Normal Distribution Calculator to compute probabilities. The calculator is free.

Problem 1

In one state, 52% of the voters are Republicans, and 48% are Democrats. In a second state, 47% of the voters are Republicans, and 53% are Democrats. Suppose 100 voters are surveyed from each state. Assume the survey uses simple random sampling.

What is the probability that the survey will show a greater percentage of Republican voters in the second state than in the first state?

(A) 0.04
(B) 0.05
(C) 0.24
(D) 0.71
(E) 0.76

Solution

The correct answer is C. For this analysis, let P₁ = the proportion of Republican voters in the first state, P₂ = the proportion of Republican voters in the second state, p₁ = the proportion of Republican voters in the sample from the first state, and p₂ = the proportion of Republican voters in the sample from the second state. The number of voters sampled from the first state (n₁) = 100, and the number of voters sampled from the second state (n₂) = 100.

The solution involves four steps.

• Make sure the samples from each population are big enough to model differences with a normal distribution. Because n₁P₁ = 100 * 0.52 = 52, n₁(1 - P₁) = 100 * 0.48 = 48, n₂P₂ = 100 * 0.47 = 47, and n₂(1 - P₂) = 100 * 0.53 = 53 are each greater than 10, the sample size is large enough.
  
  
• Find the mean of the difference in sample proportions: E(p₁ - p₂) = P₁ - P₂ = 0.52 - 0.47 = 0.05.
  
  
• Find the standard deviation of the difference.
  σ_d = sqrt{ [ P₁(1 - P₁) / n₁ ] + [ P₂(1 - P₂) / n₂ ] }
  σ_d = sqrt{ [ (0.52)(0.48) / 100 ] + [ (0.47)(0.53) / 100 ] }
  σ_d = sqrt (0.002496 + 0.002491) = sqrt(0.004987) = 0.0706
• Find the probability. This problem requires us to find the probability that p₁ is less than p₂. This is equivalent to finding the probability that p₁ - p₂ is less than zero. To find this probability, we need to transform the random variable (p₁ - p₂) into a z-score. That transformation appears below.
  z_{p1 - p2} = (x - μ_{p1 - p2}) / σ_d = = (0 - 0.05)/0.0706 = -0.7082
  Using Stat Trek's Normal Distribution Calculator, we find that the probability of a z-score being -0.7082 or less is 0.24.

Therefore, the probability that the survey will show a greater percentage of Republican voters in the second state than in the first state is 0.24.