Essays On Model Selection PDF Download

Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Essays On Model Selection PDF full book. Access full book title Essays On Model Selection.

Essays on Robust Model Selection and Model Averaging for Linear Models

Essays on Robust Model Selection and Model Averaging for Linear Models
Author: Le Chang
Publisher:
Total Pages: 0
Release: 2017
Genre:
ISBN:

Download Essays on Robust Model Selection and Model Averaging for Linear Models Book in PDF, ePub and Kindle

Model selection is central to all applied statistical work. Selecting the variables for use in a regression model is one important example of model selection. This thesis is a collection of essays on robust model selection procedures and model averaging for linear regression models. In the first essay, we propose robust Akaike information criteria (AIC) for MM-estimation and an adjusted robust scale based AIC for M and MM-estimation. Our proposed model selection criteria can maintain their robust properties in the presence of a high proportion of outliers and the outliers in the covariates. We compare our proposed criteria with other robust model selection criteria discussed in previous literature. Our simulation studies demonstrate a significant outperformance of robust AIC based on MM-estimation in the presence of outliers in the covariates. The real data example also shows a better performance of robust AIC based on MM-estimation. The second essay focuses on robust versions of the "Least Absolute Shrinkage and Selection Operator" (lasso). The adaptive lasso is a method for performing simultaneous parameter estimation and variable selection. The adaptive weights used in its penalty term mean that the adaptive lasso achieves the oracle property. In this essay, we propose an extension of the adaptive lasso named the Tukey-lasso. By using Tukey's biweight criterion, instead of squared loss, the Tukey-lasso is resistant to outliers in both the response and covariates. Importantly, we demonstrate that the Tukey-lasso also enjoys the oracle property. A fast accelerated proximal gradient (APG) algorithm is proposed and implemented for computing the Tukey-lasso. Our extensive simulations show that the Tukey-lasso, implemented with the APG algorithm, achieves very reliable results, including for high-dimensional data where p>n. In the presence of outliers, the Tukey-lasso is shown to offer substantial improvements in performance compared to the adaptive lasso and other robust implementations of the lasso. Real data examples further demonstrate the utility of the Tukey-lasso. In many statistical analyses, a single model is used for statistical inference, ignoring the process that leads to the model being selected. To account for this model uncertainty, many model averaging procedures have been proposed. In the last essay, we propose an extension of a bootstrap model averaging approach, called bootstrap lasso averaging (BLA). BLA utilizes the lasso for model selection. This is in contrast to other forms of bootstrap model averaging that use AIC or Bayesian information criteria (BIC). The use of the lasso improves the computation speed and allows BLA to be applied even when the number of variables p is larger than the sample size n. Extensive simulations confirm that BLA has outstanding finite sample performance, in terms of both variable and prediction accuracies, compared with traditional model selection and model averaging methods. Several real data examples further demonstrate an improved out-of-sample predictive performance of BLA.


Essays on Model Selection

Essays on Model Selection
Author: Hwan-sik Choi
Publisher:
Total Pages: 250
Release: 2007
Genre:
ISBN:

Download Essays on Model Selection Book in PDF, ePub and Kindle


Essays on Model Selection

Essays on Model Selection
Author: Yingyu Guo
Publisher:
Total Pages: 0
Release: 2021
Genre:
ISBN:

Download Essays on Model Selection Book in PDF, ePub and Kindle


Mathematics, Models, and Modality

Mathematics, Models, and Modality
Author: John P. Burgess
Publisher: Cambridge University Press
Total Pages: 253
Release: 2008-02-21
Genre: Science
ISBN: 113947054X

Download Mathematics, Models, and Modality Book in PDF, ePub and Kindle

John Burgess is the author of a rich and creative body of work which seeks to defend classical logic and mathematics through counter-criticism of their nominalist, intuitionist, relevantist, and other critics. This selection of his essays, which spans twenty-five years, addresses key topics including nominalism, neo-logicism, intuitionism, modal logic, analyticity, and translation. An introduction sets the essays in context and offers a retrospective appraisal of their aims. The volume will be of interest to a wide range of readers across philosophy of mathematics, logic, and philosophy of language.


Essays on Model Selection

Essays on Model Selection
Author: Eric H. Schulman
Publisher:
Total Pages: 0
Release: 2022
Genre:
ISBN:

Download Essays on Model Selection Book in PDF, ePub and Kindle

This dissertation discusses model selection and evaluation in economics from a variety of perspectives, and techniques. Chapter 1 approaches model selection from the perspective of non-nested hypothesis testing. I explore how bootstrapping can improve inference for the Vuong test. I establish that the suggested bootstrap has uniformly valid asymptotic size control in the case of both non-overlapping and overlapping models. I also show that the new test achieves an asymptotic refinement for non-overlapping models. The suggested test is easy to implement and similar to bootstrapping the standard Vuong test. When compared with other existing Vuong tests in Monte Carlo simulations, the suggested test controls size equally well and achieves higher power. Finally, I illustrate selecting models with the bootstrap in four stylized empirical examples from various fields of economics. The new test selects a model at lower significance levels in all examples. Chapter 2 is joint work with Sukjin Han, Kristen Grauman and Santosh Ramakrishnan. This chapter focuses on model evaluation in the presence of high-dimensional unstructured data on product attributes (e.g., design, text). Quantifying these attributes is important for economic analyses. We consider one of the simplest design products, fonts, and quantify their shapes by constructing embeddings using a modern convolutional neural network. The embedding maps a font's shape onto a low-dimensional vector. Importantly, we verify the resulting embedding is economically meaningful by showing that the mutual information is large between the embedding and descriptions assigned to each font by font designers and consumers. This paper then conducts two economic analyses of the font market. We first illustrate the usefulness of the embeddings by a simple trend analysis of font style. We then study the causal effect of a merger on the merging firm's creative product differentiation decisions by using the embeddings in a synthetic control method. We find that the merger causes the merging firm temporarily to increase the visual variety of font design. Chapter 3 is joint work with David Sibley. This chapter considers model selection in the context of Nash-in-Nash bargaining model with one hospital, two competing insurers, and linear demand. We find an externality related to the entry of a second insurer. This externality is directly proportional to the hospital's profit in the event of a disagreement with an insurer. We explore how different assumptions about the hospital's disagreement profit, such as passive beliefs, influence the extent of this externality thereby increasing prices and premiums. Additionally, we explore how the hospital can benefit from the externality associated with the entry of another insurer by bargaining sequentially -- one insurer before the other. We show the hospital has higher profit in a sequential negotiation. Sequential bargaining creates a second mover advantage among the insurers compared to simultaneous bargaining. Lastly, we derive empirical implications of beliefs and timing in our model, to help evaluate whether insurer competition may increase prices in practice


Essays on Model Selection

Essays on Model Selection
Author: Ivan Grigorov Jeliazkov
Publisher:
Total Pages: 138
Release: 2003
Genre:
ISBN:

Download Essays on Model Selection Book in PDF, ePub and Kindle


Essays on Model Selection Using Bayesian Inference

Essays on Model Selection Using Bayesian Inference
Author: Guo Chen
Publisher:
Total Pages: 121
Release: 2009
Genre: Bayesian statistical decision theory
ISBN:

Download Essays on Model Selection Using Bayesian Inference Book in PDF, ePub and Kindle

This dissertation is composed of three essays evaluating Bayesian model selection criteria in various models, and whenever necessary, the Bayesian criteria are compared with sampling theory criteria. In chapter two, I compare the 2-regime threshold ARMA model (TARMA) and 2-state Markov switching model (MSM). Bayesian Markov Chain Monte Carlo (MCMC) algorithms are devised to obtain coefficient estimates, conditional and unconditional predictive densities. Posterior densities and cumulative densities of the mean square error of forecast (MSEF) of two competing models are generated. The main finding is that for one-day conditional prediction, the 2-regime TARMA model predicts the interest rate better than the MSM. Under the unconditional prediction, however, MSM has less prediction error than TARMA. In chapter three, I compare the MSEF and Pseudo Bayes Factor (PSBF) obtained by 10-fold CV method and those from an out of sample prediction for fixed points. The MSEF suggests there is a slightly superior performance for the CV method in model selection over traditional out-of-sample forecast in the i.i.d sample. However, the same result is not obtained by PSBF. By excluding forecasted data in constructing coefficients within MCMC, the out-of-sample method is further improved by yielding higher probability to select the true model. In chapter four, I evaluate logit and probit binary choice models. Monte Carlo experiments are conducted to compare the following five criteria in choosing the univariate probit and logit models: the deviance information criterion (DIC), predictive DIC, Akaike information criterion (AIC), weighted and unweighted sums of squared errors. The results show that if data are balanced no model selection criterion can distinguish the probit and logit models. If data are unbalanced and the sample size is large the DIC and AIC choose the correct models better than the other criteria. If unbalanced binary data are generated by a leptokurtic distribution the logit model is preferred over the probit model. The probit model is preferred if unbalanced data are generated by a platykurtic distribution.


Three Essays on Model Selection

Three Essays on Model Selection
Author: Fangning Li
Publisher:
Total Pages: 127
Release: 2020
Genre: Averaging method (Differential equations)
ISBN:

Download Three Essays on Model Selection Book in PDF, ePub and Kindle


Models for Modalities

Models for Modalities
Author: Jaakko Hintikka
Publisher: Springer Science & Business Media
Total Pages: 225
Release: 2012-12-06
Genre: Philosophy
ISBN: 9401017115

Download Models for Modalities Book in PDF, ePub and Kindle

The papers collected in this volume were written over a period of some eight or nine years, with some still earlier material incorporated in one of them. Publishing them under the same cover does not make a con tinuous book of them. The papers are thematically connected with each other, however, in a way which has led me to think that they can naturally be grouped together. In any list of philosophically important concepts, those falling within the range of application of modal logic will rank high in interest. They include necessity, possibility, obligation, permission, knowledge, belief, perception, memory, hoping, and striving, to mention just a few of the more obvious ones. When a satisfactory semantics (in the sense of Tarski and Carnap) was first developed for modal logic, a fascinating new set of methods and ideas was thus made available for philosophical studies. The pioneers of this model theory of modality include prominently Stig Kanger and Saul Kripke. Several others were working in the same area independently and more or less concurrently. Some of the older papers in this collection, especially 'Quantification and Modality' and 'Modes of Modality', serve to clarify some of the main possibilities in the semantics of modal logics in general.