Scholars Central

Conference abstractPublished 20 Oct 2014

Big data analysis: Big biases

Authors: S Ejaz Ahmed

Ask about this article

Abstract

Select any words in the title or abstract, or press this and choose a sentence.

In high-dimensional data settings where the number of variables is greater than observations, many penalized regularization approaches were studied for simultaneous variable selection and estimation. With the existence of covariates with weak effect, however, many existing variable selection methods, including Lasso and its generations, cannot distinguish covariates with weak and no contribution. Thus, prediction based on a submodel of selected covariates may not be trust worthy. In this talk, a high-dimensional shrinkage estimation strategy to improve the prediction performance of a submodel is proposed. Such a high-dimensional shrinkage estimator (HDSE) is constructed by shrinking a weighted ridge estimator in the direction of a predefined candidate submodel. Under an asymptotic distributional quadratic risk criterion, its prediction performance is explored analytically. It is shown that the proposed HDSE performs better than the weighted ridge estimator. More importantly, it significantly improves the prediction performance of any candidate submodel generated from most existing Lasso-type variable selection methods. The relative performance of the proposed HDS strategy is demonstrated by both simulation studies and the real data analysis.

Ask about this article

Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.

Try:

Similar by topic

More from this journal

The newest in Journal of Biometrics & Biostatistics.

All its articles

Follow

New articles from what you follow go into your email digest, once you agree to alert emails.

  • JournalJournal of Biometrics & Biostatistics
  • SubjectMathematics & Statistics
  • BylineArticles whose byline prints “S Ejaz Ahmed”

For authors and organisers

Publish, present and keep up with your field

Find the right journal for your paper and submit your manuscript.

Photo: Pexels