Select term:
Statistics Dictionary Absolute Value Accuracy Addition Rule Alpha Alternative Hypothesis ANOVA Back-to-Back Stemplots Balanced Design Bar Chart Bartlett's Test Bayes Rule Bayes Theorem Bias Biased Estimate Bimodal Distribution Binomial Distribution Binomial Experiment Binomial Probability Binomial Random Variable Bivariate Data Blinding Blocking Blocking Variable Bonferroni Correction Boxplot Cartesian Plane Categorical Variable Census Central Limit Theorem Chi-Square Distribution Chi-Square Goodness of Fit Test Chi-Square Statistic Chi-Square Test for Homogeneity Chi-Square Test for Independence Cluster Cluster Sampling Coefficient of Determination Coefficient of Multiple Determination Column Vector Combination Comparisons Complement Completely Randomized Design Conditional Distribution Conditional Frequency Conditional Probability Confidence Interval Confidence Level Confounding Contingency Table Continuous Probability Distribution Continuous Variable Control Group Convenience Sample Correlation Covariance Critical Parameter Value Critical Value Cumulative Frequency Cumulative Frequency Plot Cumulative Probability Decision Rule Degrees of Freedom Dependent Variable Determinant Deviation Score Diagonal Matrix Discrete Probability Distribution Discrete Variable Discriminant Analysis Disjoint Disproportionate Stratification Dotplot Double Bar Chart Double Blinding Dummy Variable E Notation Echelon Matrix Effect Size Element Elementary Matrix Operations Elementary Operators Empty Set Epsilon Error Rate Familywise Error Rate per Comparison Estimation Estimator Event Event Multiple Expected Value Experiment Experimental Design Extraneous Variable F Distribution F Statistic Factor Factorial Factorial Experiment Finite Population Correction Fixed Effects Model Fixed Factor Frequency Count Frequency Table Full Rank Gaps in Graphs Geometric Distribution Geometric Probability Hartley's Fmax Test Heterogeneous Histogram Homogeneous Hypergeometric Distribution Hypergeometric Experiment Hypergeometric Probability Hypergeometric Random Variable Hypothesis Test Identity Matrix Independent Independent Groups Design Independent Variable Influential Point Inner Product Interaction Plot Interactions Interquartile Range Intersection Interval Estimate Interval Scale Inverse IQR Joint Frequency Joint Probability Distribution Law of Large Numbers Level Line Linear Combination of Vectors Linear Dependence of Vectors Linear Transformation Logarithm Lurking Variable Margin of Error Marginal Distribution Marginal Frequency Marginal Mean Matched Pairs Design Matched-Pairs t-Test Matrix Matrix Dimension Matrix Inverse Matrix Order Matrix Rank Matrix Transpose Mauchly's Sphericity Test Mean Mean Square Measurement Scales Median Mixed Model Mode Multicollinearity Multinomial Distribution Multinomial Experiment Multiple Regression Multiplication Rule Multistage Sampling Mutually Exclusive Natural Logarithm Negative Binomial Distribution Negative Binomial Experiment Negative Binomial Probability Negative Binomial Random Variable Neyman Allocation Nominal Scale Nonlinear Transformation Non-Probability Sampling Nonresponse Bias Normal Distribution Normal Random Variable Null Hypothesis Null Set Observational Study One-Sample t-Test One-Sample z-Test One-stage Sampling One-Tailed Test One-Way ANOVA One-Way Table Optimum Allocation Ordinal Scale Orthogonal Comparisons Outer Product Outlier Paired Data Parallel Boxplots Parameter Pearson Product-Moment Correlation Percentage Percentile Permutation Placebo Planned Comparisons Point Estimate Poisson Distribution Poisson Experiment Poisson Probability Poisson Random Variable Population Post Hoc Comparisons Power Precision Probability Probability Density Function Probability Distribution Probability Sampling Proportion Proportionate Stratification P-Value Qualitative Variable Quantitative Variable Quartile Random Effects Model Random Factor Random Number Table Random Numbers Random Sampling Random Variable Randomization Randomized Block Design Randomized Block Experiment Range Ratio Scale Reduced Row Echelon Form Region of Acceptance Region of Rejection Regression Relative Frequency Relative Frequency Table Repeated Measures Design Replication Representative Residual Residual Plot Response Bias Row Echelon Form Row Vector Sample Sample Design Sample Point Sample Space Sample Survey Sampling Sampling Distribution Sampling Error Sampling Fraction Sampling Method Sampling With Replacement Sampling Without Replacement Scalar Matrix Scalar Multiple Scatterplot Scheffe Test Selection Bias Set Significance Level Simple Random Sampling Simple Regression Singular Matrix Skewness Slope Sphericity Standard Deviation Standard Error Standard Normal Distribution Standard Score Statistic Statistical Experiment Statistical Hypothesis Statistics Stemplot Strata Stratified Sampling Subset Subtraction Rule Sum Vector Sums of Squares Symmetric Matrix Symmetry Systematic Sampling T Distribution T Score T Statistic Test Statistic Transpose Treatment t-Test Two-Sample t-Test Two-stage Sampling Two-Tailed Test Two-Way Table Type I Error Type II Error Unbiased Estimate Undercoverage Uniform Distribution Unimodal Distribution Union Univariate Data Variable Variance Variance Inflation Factor Vector Inner Product Vector Outer Product Vectors Venn Diagram Voluntary Response Bias Voluntary Sample Y Intercept z-score

Regression

In a cause and effect relationship, the independent variable is the cause, and the dependent variable is the effect. Least squares linear regression is a method for predicting the value of a dependent variable Y, based on the value of an independent variable X.

Linear regression finds the straight line, called the least squares regression line or LSRL, that best represents observations in a bivariate data set. Suppose Y is a dependent variable, and X is an independent variable. Then, the equation for the regression line would be:

ŷ = b₀ + b₁x

where b₀ is a constant, b₁ is the regression coefficient, x is the value of the independent variable, and ŷ is the predicted value of the dependent variable.

Normally, you will use a computational tool - a software package (e.g., Excel) or a graphing calculator - to find b₀ and b₁. You enter the X and Y values into your program or calculator, and the tool solves for each parameter.

In the unlikely event that you find yourself on a desert island without a computer or a graphing calculator, you can solve for b₀ and b₁ "by hand". Here are the equations.

b₁ = Σ [ (x_i - x)(y_i - y) ] / Σ [ (x_i - x)²]      

and

b₀ = y - b₁ * x

where b₀ is the constant in the regression equation, b₁ is the regression coefficient, x_i is the X value of observation i, y_i is the Y value of observation i, and x and y are the means of X and Y, respectively.

See also:

AP Statistics Tutorial: Least Squares Linear Regression