In statistics, unit-weighted regression is a simplified and robust version (Wainer & Thissen, 1976) of multiple regression analysis where only the intercept term is estimated. That is, it fits a model
y ^ = f ^ ( x ) = b ^ + ∑ i x i , {\displaystyle {\hat {y}}={\hat {f}}(\mathbf {x} )={\hat {b}}+\sum _{i}x_{i},}
where each of the x i {\displaystyle x_{i}} are binary variables, perhaps multiplied with an arbitrary weight. Contrast this with the more common multiple regression model, where each predictor has its own estimated coefficient:
y ^ = f ^ ( x ) = b ^ + ∑ i w ^ i x i . {\displaystyle {\hat {y}}={\hat {f}}(\mathbf {x} )={\hat {b}}+\sum _{i}{\hat {w}}_{i}x_{i}.}
In the social sciences, unit-weighted regression is sometimes used for binary classification, i.e. to predict a yes-no answer where y ^ < 0 {\displaystyle {\hat {y}}<0} indicates "no", y ^ ≥ 0 {\displaystyle {\hat {y}}\geq 0} "yes". It is easier to interpret than multiple linear regression (known as linear discriminant analysis in the classification case).
Unit weights Unit-weighted regression is a method of robust regression that proceeds in three steps. First, predictors for the outcome of interest are selected; ideally, there should be good empirical or theoretical reasons for the selection. Second, the predictors are converted to a standard form. Finally, the predictors are added together, and this sum is called the variate, which is used as the predictor of the outcome.
Burgess method The Burgess method was first presented by the sociologist Ernest W. Burgess in a 1928 study to determine success or failure of inmates placed on parole. First, he selected 21 variables believed to be associated with parole success. Next, he converted each predictor to the standard form of zero or one (Burgess, 1928). When predictors had two values, the value associated with the target outcome was coded as one. Burgess selected success on parole as the target outcome, so a predictor such as a history of theft was coded as "yes" = 0 and "no" = 1. These coded values were then added to create a predictor score, so that higher scores predicted a better chance of success. The scores could possibly range from zero (no predictors of success) to 21 (all 21 predictors scored as predicting success). For predictors with more than two values, the Burgess method selects a cutoff score based on subjective judgment. As an example, a study using the Burgess method (Gottfredson & Snyder, 2005) selected as one predictor the number of complaints for delinquent behavior. With failure on parole as the target outcome, the number of complaints was coded as follows: "zero to two complaints" = 0, and "three or more complaints" = 1 (Gottfredson & Snyder, 2005. p. 18).
Kerby method The Kerby method is similar to the Burgess method, but differs in two ways. First, while the Burgess method uses subjective judgment to select a cutoff score for a multi-valued predictor with a binary outcome, the Kerby method uses classification and regression tree (CART) analysis. In this way, the selection of the cutoff score is based not on subjective judgment, but on a statistical criterion, such as the point where the chi-square value is a maximum. The second difference is that while the Burgess method is applied to a binary outcome, the Kerby method can apply to a multi-valued outcome, because CART analysis can identify cutoff scores in such cases, using a criterion such as the point where the t-value is a maximum. Because CART analysis is not only binary, but also recursive, the result can be that a predictor variable will be divided again, yielding two cutoff scores. The standard form for each predictor is that a score of one is added when CART analysis creates a partition. One study (Kerby, 2003) selected as predictors the five traits of the Big five personality traits, predicting a multi-valued measure of suicidal ideation. Next, the personality scores were converted into standard form with CART analysis. When the CART analysis yielded one partition, the result was like the Burgess method in that the predictor was coded as either zero or one. But for the measure of neuroticism, the result was two cutoff scores. Because higher neuroticism scores correlated with more suicidal thinking, the two cutoff scores led to the following coding: "low Neuroticism" = 0, "moderate Neuroticism" = 1, "high Neuroticism" = 2 (Kerby, 2003).
z-score method Another method can be applied when the predictors are measured on a continuous scale. In such a case, each predictor can be converted into a standard score, or z-score, so that all the predictors have a mean of zero and a standard deviation of one. With this method of unit-weighted regression, the variate is a sum of the z-scores (e.g., Dawes, 1979; Bobko, Roth, & Buster, 2007).
… excerpt ends here. Continue reading the full article.
