Regression Modeling

Many texts are excellent sources of knowledge about individual statistical tools, but the art of data analysis is about choosing and using multiple tools. Instead of presenting isolated techniques, this text emphasizes problem solving strategies that address the many issues arising when developing multivariable models using real data and not standard textbook examples. It includes imputation methods for dealing with missing data effectively, methods for dealing with nonlinear relationships and for making the estimation of transformations a formal part of the modeling process, methods for dealing with "too many variables to analyze and not enough observations," and powerful model validation techniques based on the bootstrap. This text realistically deals with model uncertainty and its effects on inference to achieve "safe data mining".

Despite the recent rapid growth in machine learning and predictive analytics, many of the statistical questions that are faced by researchers and practitioners still involve explaining why something is happening. Regression analysis is the best ‘swiss army knife’ we have for answering these kinds of questions. This book is a learning resource on inferential statistics and regression analysis. It teaches how to do a wide range of statistical analyses in both R and in Python, ranging from simple hypothesis testing to advanced multivariate modelling. Although it is primarily focused on examples related to the analysis of people and talent, the methods easily transfer to any discipline. The book hits a ‘sweet spot’ where there is just enough mathematical theory to support a strong understanding of the methods, but with a step-by-step guide and easily reproducible examples and code, so that the methods can be put into practice immediately. This makes the book accessible to a wide readership, from public and private sector analysts and practitioners to students and researchers. Key Features: • 16 accompanying datasets across a wide range of contexts (e.g. academic, corporate, sports, marketing) • Clear step-by-step instructions on executing the analyses. • Clear guidance on how to interpret results. • Primary instruction in R but added sections for Python coders. • Discussion exercises and data exercises for each of the main chapters. • Final chapter of practice material and datasets ideal for class homework or project work.

Praise for the First Edition "The attention to detail is impressive. The book is very well written and the author is extremely careful with his descriptions . . . the examples are wonderful." —The American Statistician Fully revised to reflect the latest methodologies and emerging applications, Applied Regression Modeling, Second Edition continues to highlight the benefits of statistical methods, specifically regression analysis and modeling, for understanding, analyzing, and interpreting multivariate data in business, science, and social science applications. The author utilizes a bounty of real-life examples, case studies, illustrations, and graphics to introduce readers to the world of regression analysis using various software packages, including R, SPSS, Minitab, SAS, JMP, and S-PLUS. In a clear and careful writing style, the book introduces modeling extensions that illustrate more advanced regression techniques, including logistic regression, Poisson regression, discrete choice models, multilevel models, and Bayesian modeling. In addition, the Second Edition features clarification and expansion of challenging topics, such as: Transformations, indicator variables, and interaction Testing model assumptions Nonconstant variance Autocorrelation Variable selection methods Model building and graphical interpretation Throughout the book, datasets and examples have been updated and additional problems are included at the end of each chapter, allowing readers to test their comprehension of the presented material. In addition, a related website features the book's datasets, presentation slides, detailed statistical software instructions, and learning resources including additional problems and instructional videos. With an intuitive approach that is not heavy on mathematical detail, Applied Regression Modeling, Second Edition is an excellent book for courses on statistical regression analysis at the upper-undergraduate and graduate level. The book also serves as a valuable resource for professionals and researchers who utilize statistical methods for decision-making in their everyday work.

This book teaches multiple regression and time series and how to use these to analyze real data in risk management and finance.

Spatial Regression Models illustrates the use of spatial analysis in the social sciences within a regression framework and is accessible to readers with no prior background in spatial analysis. The text covers different modeling-related topics for continuous dependent variables, including: mapping data on spatial units, exploratory spatial data analysis, working with regression models that have spatially dependent regressors, and estimating regression models with spatially correlated error structures. Using social sciences examples based on real data, Michael D. Ward and Kristian Skrede Gleditsch illustrate the concepts discussed, and show how to obtain and interpret relevant results. The examples are presented along with the relevant code to replicate all the analysis using the R package for statistical computing. Users can download both the data and computer code to work through all the examples found in the text. New to the Second Edition is a chapter on mapping as data exploration and its role in the research process, updates to all chapters based on substantive and methodological work, as well as software updates, and information on estimation of time-series, cross-sectional spatial models.

This book, first published in 2007, is for the applied researcher performing data analysis using linear and nonlinear regression and multilevel models.

Regression Modeling: Methods, Theory, and Computation with SAS provides an introduction to a diverse assortment of regression techniques using SAS to solve a wide variety of regression problems. The author fully documents the SAS programs and thoroughly explains the output produced by the programs. The text presents the popular ordinary least squares (OLS) approach before introducing many alternative regression methods. It covers nonparametric regression, logistic regression (including Poisson regression), Bayesian regression, robust regression, fuzzy regression, random coefficients regression, L1 and q-quantile regression, regression in a spatial domain, ridge regression, semiparametric regression, nonlinear least squares, and time-series regression issues. For most of the regression methods, the author includes SAS procedure code, enabling readers to promptly perform their own regression runs. A Comprehensive, Accessible Source on Regression Methodology and Modeling Requiring only basic knowledge of statistics and calculus, this book discusses how to use regression analysis for decision making and problem solving. It shows readers the power and diversity of regression techniques without overwhelming them with calculations.

INLA stands for Integrated Nested Laplace Approximations, which is a new method for fitting a broad class of Bayesian regression models. No samples of the posterior marginal distributions need to be drawn using INLA, so it is a computationally convenient alternative to Markov chain Monte Carlo (MCMC), the standard tool for Bayesian inference. Bayesian Regression Modeling with INLA covers a wide range of modern regression models and focuses on the INLA technique for building Bayesian models using real-world data and assessing their validity. A key theme throughout the book is that it makes sense to demonstrate the interplay of theory and practice with reproducible studies. Complete R commands are provided for each example, and a supporting website holds all of the data described in the book. An R package including the data and additional functions in the book is available to download. The book is aimed at readers who have a basic knowledge of statistical theory and Bayesian methodology. It gets readers up to date on the latest in Bayesian inference using INLA and prepares them for sophisticated, real-world work. Xiaofeng Wang is Professor of Medicine and Biostatistics at the Cleveland Clinic Lerner College of Medicine of Case Western Reserve University and a Full Staff in the Department of Quantitative Health Sciences at Cleveland Clinic. Yu Ryan Yue is Associate Professor of Statistics in the Paul H. Chook Department of Information Systems and Statistics at Baruch College, The City University of New York. Julian J. Faraway is Professor of Statistics in the Department of Mathematical Sciences at the University of Bath.