Correlation Coefficient
Correlation coefficients measure the strength of
association between two variables. The most common correlation
coefficient, called the
Pearson product-moment correlation coefficient,
measures the strength of the
linear association between variables measured on an
interval or
ratio scale.
In this tutorial, when we speak simply of a correlation
coefficient, we are referring to the Pearson product-moment
correlation. Generally, the correlation coefficient of a
sample
is denoted by
r, and the correlation coefficient of a
population
is denoted by
ρ or R.
How to Interpret a Correlation Coefficient
The sign and the
absolute value
of a correlation coefficient
describe the direction and the magnitude of the relationship
between two variables.
- A negative correlation means that if one variable gets bigger,
the other variable tends to get smaller.
Keep in mind that the Pearson product-moment correlation coefficient
only measures
linear relationships. Therefore, a correlation of 0 does not
mean zero relationship between two variables; rather, it means
zero linear relationship. (It is possible for two
variables to have zero linear relationship and a strong
curvilinear relationship at the same time.)
Scatterplots and Correlation Coefficients
The scatterplots
below show how different patterns of data produce different degrees of
correlation.
Maximum positive correlation
(r = 1.0)
Strong positive correlation
(r = 0.80)
Zero correlation
(r = 0)
Maximum negative correlation
(r = -1.0)
Moderate negative correlation
(r = -0.43)
Strong correlation & outlier
(r = 0.71)
Several points are evident from the scatterplots.
How to Calculate a Correlation Coefficient
If you look in different statistics textbooks,
you are likely to find different-looking (but equivalent) formulas for
computing a correlation coefficient. In this section, we
present several formulas that you may encounter.
The most common formula for computing a product-moment correlation coefficient (r)
is given below.
Product-moment correlation
coefficient.
The correlation r between two variables is:
r = Σ (xy) / sqrt [ ( Σ x^{2} ) * ( Σ y^{2} ) ]
where Σ is the summation symbol,
x = x_{i} - x,
x_{i} is the x value for observation i,
x is the mean x value,
y = y_{i} - y,
y_{i} is the y value for observation i, and
y is the mean y value.
The formula below uses population means and population standard deviations
to compute a population correlation coefficient (ρ) from population data.
Population correlation
coefficient.
The correlation ρ between two variables is:
ρ = [ 1 / N ] * Σ { [ (X_{i} - μ_{X}) / σ_{x} ]
* [ (Y_{i} - μ_{Y}) / σ_{y} ] }
where N is the number of
observations in the population, Σ is the summation symbol,
X_{i} is the X value for observation i,
μ_{X} is the population mean for variable X,
Y_{i} is the Y value for observation i,
μ_{Y} is the population mean for variable Y,
σ_{x} is the population standard deviation of X, and
σ_{y} is the population standard deviation of Y.
The formula below uses sample means and sample standard deviations
to compute a sample correlation coefficient (r) from sample data.
Sample correlation
coefficient.
The correlation r between two variables is:
r = [ 1 / (n - 1) ] * Σ { [ (x_{i} - x) / s_{x} ]
* [ (y_{i} - y) / s_{y} ] }
where n is the number of
observations in the sample, Σ is the summation symbol,
x_{i} is the x value for observation i,
x is the sample mean of x,
y_{i} is the y value for observation i,
y is the sample mean of y,
s_{x} is the sample standard deviation of x, and
s_{y} is the sample standard deviation of y.
The interpretation of the sample correlation coefficient depends on how the
sample data are collected. With a large
simple random sample,
the sample correlation coefficient is an unbiased estimate of the population
correlation coefficient.
Each of the latter two formulas can be derived from the first formula.
Use the first or second formula when you have data from the entire population.
Use the third formula when you only have sample data, but want to estimate
the correlation in the population. When in doubt, use the first formula.
Fortunately, you will rarely have to compute a correlation
coefficient by hand. Many software packages (e.g., Excel) and most graphing calculators
have a correlation function that will do the job for you.
Test Your Understanding
Problem 1
A national consumer magazine reported the following correlations.
- The correlation between car weight and car reliability is -0.30.
- The correlation between car weight and annual maintenance cost
is 0.20.
Which of the following statements are true?
I. Heavier cars tend to be less reliable.
II. Heavier cars tend to cost more to maintain.
III. Car weight is related more strongly to reliability than to
maintenance cost.
(A) I only
(B) II only
(C) III only
(D) I and II only
(E) I, II, and III
Solution
The correct answer is (E). The correlation between car weight
and reliability is negative. This means that reliability tends to
decrease as car weight increases. The correlation between car
weight and maintenance cost is positive. This means that maintenance
costs tend to increase as car weight increases.
The strength of a relationship between two variables is indicated by the
absolute value
of the correlation coefficient. The correlation between car weight
and reliability has an absolute value of 0.30. The correlation
between car weight and maintenance cost has an absolute value of
0.20. Therefore, the relationship between car weight and
reliability is stronger than the relationship between car weight
and maintenance cost.