Article · 24 Apr 2024
Conference abstractPublished 20 Oct 2014
Big data analysis: Big biases
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
In high-dimensional data settings where the number of variables is greater than observations, many penalized regularization approaches were studied for simultaneous variable selection and estimation. With the existence of covariates with weak effect, however, many existing variable selection methods, including Lasso and its generations, cannot distinguish covariates with weak and no contribution. Thus, prediction based on a submodel of selected covariates may not be trust worthy. In this talk, a high-dimensional shrinkage estimation strategy to improve the prediction performance of a submodel is proposed. Such a high-dimensional shrinkage estimator (HDSE) is constructed by shrinking a weighted ridge estimator in the direction of a predefined candidate submodel. Under an asymptotic distributional quadratic risk criterion, its prediction performance is explored analytically. It is shown that the proposed HDSE performs better than the weighted ridge estimator. More importantly, it significantly improves the prediction performance of any candidate submodel generated from most existing Lasso-type variable selection methods. The relative performance of the proposed HDS strategy is demonstrated by both simulation studies and the real data analysis.
Subjects
Mathematics & StatisticsAsk about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Short communication · 28 Feb 2023
Statistical Methods for Big Data Analysis
Conference abstract · 13 Nov 2017
Big data analysis in bioinformatics
Conference abstract · 16 Nov 2015
Big data information system: Challenges and analysis
Article · 29 Oct 2025
Big Data Revolutionizes Biometrics, Biostatistics and Healthcare
More from this journal
The newest in Journal of Biometrics & Biostatistics.
Article · 29 Dec 2025
Biometrics Enhance EHR Security and Patient Safety
Article · 29 Dec 2025
Biometric and Clinical Data for Enhanced Risk Prediction
Article · 29 Dec 2025
Advanced Statistics for Precision Public Health Innovations
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalJournal of Biometrics & Biostatistics
- SubjectMathematics & Statistics
- BylineArticles whose byline prints “S Ejaz Ahmed”

