Skip to main page content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2008 Dec 16;3:17.
doi: 10.1186/1751-0473-3-17.

Purposeful Selection of Variables in Logistic Regression

Affiliations
Free PMC article

Purposeful Selection of Variables in Logistic Regression

Zoran Bursac et al. Source Code Biol Med. .
Free PMC article

Abstract

Background: The main problem in many model-building situations is to choose from a large set of covariates those that should be included in the "best" model. A decision to keep a variable in the model might be based on the clinical or statistical significance. There are several variable selection algorithms in existence. Those methods are mechanical and as such carry some limitations. Hosmer and Lemeshow describe a purposeful selection of covariates within which an analyst makes a variable selection decision at each step of the modeling process.

Methods: In this paper we introduce an algorithm which automates that process. We conduct a simulation study to compare the performance of this algorithm with three well documented variable selection procedures in SAS PROC LOGISTIC: FORWARD, BACKWARD, and STEPWISE.

Results: We show that the advantage of this approach is when the analyst is interested in risk factor modeling and not just prediction. In addition to significant covariates, this variable selection procedure has the capability of retaining important confounding variables, resulting potentially in a slightly richer model. Application of the macro is further illustrated with the Hosmer and Lemeshow Worchester Heart Attack Study (WHAS) data.

Conclusion: If an analyst is in need of an algorithm that will help guide the retention of significant covariates as well as confounding ones they should consider this macro as an alternative tool.

Figures

Figure 1
Figure 1
%PurposefulSelection macro flow chart.

Similar articles

See all similar articles

Cited by 566 articles

See all "Cited by" articles

References

    1. Hosmer DW, Lemeshow S. Applied Logistic Regression. New York: Wiley; 2000.
    1. Hosmer DW, Lemeshow S. Applied Survival Analysis: Regression Modeling of Time to Event Data. New York: Wiley; 1999.
    1. Russell SJ, Norvig P. Artificial Intelligence: A Modern Approach. New Jersey: Prentice Hall; 2003.
    1. Gutin G, Yeo A, Zverovich A. Traveling salesman should not be greedy: domination analysis of greedy-type heuristics for the TSP. Discrete Applied Mathematics. 2002;117:81–86. doi: 10.1016/S0166-218X(01)00195-0. - DOI
    1. Bang-Jensen J, Gutin G, Yeo A. When the greedy algorithm fails. Discrete Optimization. 2004;1:121–127. doi: 10.1016/j.disopt.2004.03.007. - DOI

LinkOut - more resources

Feedback