Stat Trek

Teach yourself statistics

Stat Trek

Teach yourself statistics

Regression Tutorial

Linear regression is a statistical method used to model the relationship between a dependent variable and one or more independent variables. If you want to predict the value of a dependent variable, based on the value of one or more independent variables, linear regression is the tool for you.

This tutorial covers linear regression in just a few short lessons, focusing on three broad topics:

  • Prerequisites. To understand linear regression, you need to understand measurement scales and correlation.
  • Simple linear regression. Regression between one dependent variable and a single independent variable.
  • Multiple regression. Regression between one dependent variable and two or more independent variables.

Throughout the tutorial, key points are illustrated with clear, step-by-step examples. By the end of the tutorial, you will be able to compute all of the essential outputs for simple linear regression by hand. And you will be able to generate the same outputs for multiple regression, using statistical software. Most important, you will be able to correctly interpret the outputs you produce.

How to Use This Tutorial

This tutorial is designed for students and researchers who have some familiarity with introductory statistics (e.g., a high school statistics course or Advanced Placement Statistics). Even if you have no prior experience with regression, you can work through the tutorial at your own pace and teach yourself how and when to use linear regression!

Individual lessons are accessible through the table of contents, which can be found in the vertical column on the left side of the page. You should work through lessons in the order in which they appear; because some lessons build on previous lessons.

Individual lessons are accessible through the table of contents, which can be accessed by tapping the "Linear Regression: Table of Contents" button at the top of the page. You should work through lessons in the order in which they appear; because some lessons build on previous lessons.

Additional Helpful Resources

As you progress through the tutorial, take advantage of the following helpful resources.

  • Analytical tools. Stat Trek provides a variety of analytical tools - online statistical tables and probability calculators - to take the drudgery out of statistical computations. The tutorial will alert you to these tools, all of which are free.
  • Sample problems. Most of the lessons include sample problems. The sample problems test your knowledge. They also illustrate shortcuts and solutions to common statistics problems.
  • Online help. Stat Trek's online Statistics Dictionary takes the mystery out of statistical jargon. If any term or concept is unclear, visit the dictionary for additional explanation.

Note: The dictionary can be accessed by clicking the Help tab in the main menu (located at the top of this web page).