Regression Analysis

By assuming it is possible to understand regression analysis without fully comprehending all its underlying proofs and theories, this introduction to the widely used statistical technique is accessible to readers who may have only a rudimentary knowledge of mathematics. Chapters discuss: -descriptive statistics using vector notation and the components of a simple regression model; -the logic of sampling distributions and simple hypothesis testing; -the basic operations of matrix algebra and the properties of the multiple regression model; -testing compound hypotheses and the application of the regression model to the analyses of variance and covariance, and -structural equation models and influence statistics.

Understanding Regression Analysis: An Introductory Guide by Larry D. Schroeder, David L. Sjoquist, and Paula E. Stephan presents the fundamentals of regression analysis, from its meaning to uses, in a concise, easy-to-read, and non-technical style. It illustrates how regression coefficients are estimated, interpreted, and used in a variety of settings within the social sciences, business, law, and public policy. Packed with applied examples and using few equations, the book walks readers through elementary material using a verbal, intuitive interpretation of regression coefficients, associated statistics, and hypothesis tests. The Second Edition features updated examples and new references to modern software output.

Providing beginners with a background to the frequently-used technique of linear regression, this text provides a heuristic explanation of the procedures and terms used in regression analysis and has been written at the most elementary level.

Combining a modern, data-analytic perspective with a focus on applications in the social sciences, the Third Edition of Applied Regression Analysis and Generalized Linear Models provides in-depth coverage of regression analysis, generalized linear models, and closely related methods, such as bootstrapping and missing data. Updated throughout, this Third Edition includes new chapters on mixed-effects models for hierarchical and longitudinal data. Although the text is largely accessible to readers with a modest background in statistics and mathematics, author John Fox also presents more advanced material in optional sections and chapters throughout the book. Accompanying website resources containing all answers to the end-of-chapter exercises. Answers to odd-numbered questions, as well as datasets and other student resources are available on the author′s website. NEW! Bonus chapter on Bayesian Estimation of Regression Models also available at the author′s website.

Regression Analysis provides complete coverage of the classical methods of statistical analysis. It is designed to give students an understanding of the purpose of statistical analyses, to allow the student to determine, at least to some degree, the correct type of statistical analyses to be performed in a given situation, and have some appreciation of what constitutes good experimental design. Examples and exercises contain real data and graphical illustration for ease of interpretation Outputs from SAS 7, SPSS 7, Excel, and Minitab are used for illustration, but any major statisticalsoftware package will work equally well

Understanding Regression Analysis unifies diverse regression applications including the classical model, ANOVA models, generalized models including Poisson, Negative binomial, logistic, and survival, neural networks, and decision trees under a common umbrella -- namely, the conditional distribution model. It explains why the conditional distribution model is the correct model, and it also explains (proves) why the assumptions of the classical regression model are wrong. Unlike other regression books, this one from the outset takes a realistic approach that all models are just approximations. Hence, the emphasis is to model Nature’s processes realistically, rather than to assume (incorrectly) that Nature works in particular, constrained ways. Key features of the book include: Numerous worked examples using the R software Key points and self-study questions displayed "just-in-time" within chapters Simple mathematical explanations ("baby proofs") of key concepts Clear explanations and applications of statistical significance (p-values), incorporating the American Statistical Association guidelines Use of "data-generating process" terminology rather than "population" Random-X framework is assumed throughout (the fixed-X case is presented as a special case of the random-X case) Clear explanations of probabilistic modelling, including likelihood-based methods Use of simulations throughout to explain concepts and to perform data analyses This book has a strong orientation towards science in general, as well as chapter-review and self-study questions, so it can be used as a textbook for research-oriented students in the social, biological and medical, and physical and engineering sciences. As well, its mathematical emphasis makes it ideal for a text in mathematics and statistics courses. With its numerous worked examples, it is also ideally suited to be a reference book for all scientists.

This book is an introduction to regression analysis, focusing on the practicalities of doing regression analysis on real-life data. Contrary to other textbooks on regression, this book is based on the idea that you do not necessarily need to know much about statistics and mathematics to get a firm grip on regression and perform it to perfection. This non-technical point of departure is complemented by practical examples of real-life data analysis using statistics software such as Stata, R and SPSS. Parts 1 and 2 of the book cover the basics, such as simple linear regression, multiple linear regression, how to interpret the output from statistics programs, significance testing and the key regression assumptions. Part 3 deals with how to practically handle violations of the classical linear regression assumptions, regression modeling for categorical y-variables and instrumental variable (IV) regression. Part 4 puts the various purposes of, or motivations for, regression into the wider context of writing a scholarly report and points to some extensions to related statistical techniques. This book is written primarily for those who need to do regression analysis in practice, and not only to understand how this method works in theory. The book’s accessible approach is recommended for students from across the social sciences.

′The editors of the new SAGE Handbook of Regression Analysis and Causal Inference have assembled a wide-ranging, high-quality, and timely collection of articles on topics of central importance to quantitative social research, many written by leaders in the field. Everyone engaged in statistical analysis of social-science data will find something of interest in this book.′ - John Fox, Professor, Department of Sociology, McMaster University ′The authors do a great job in explaining the various statistical methods in a clear and simple way - focussing on fundamental understanding, interpretation of results, and practical application - yet being precise in their exposition.′ - Ben Jann, Executive Director, Institute of Sociology, University of Bern ′Best and Wolf have put together a powerful collection, especially valuable in its separate discussions of uses for both cross-sectional and panel data analysis.′ -Tom Smith, Senior Fellow, NORC, University of Chicago Edited and written by a team of leading international social scientists, this Handbook provides a comprehensive introduction to multivariate methods. The Handbook focuses on regression analysis of cross-sectional and longitudinal data with an emphasis on causal analysis, thereby covering a large number of different techniques including selection models, complex samples, and regression discontinuities. Each Part starts with a non-mathematical introduction to the method covered in that section, giving readers a basic knowledge of the method’s logic, scope and unique features. Next, the mathematical and statistical basis of each method is presented along with advanced aspects. Using real-world data from the European Social Survey (ESS) and the Socio-Economic Panel (GSOEP), the book provides a comprehensive discussion of each method’s application, making this an ideal text for PhD students and researchers embarking on their own data analysis.