Conference abstract · 24 Oct 2016
Research articlePublished 2019
Application of Gradient Boosting Algorithm In Statistical Modelling
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
Gradient Boosting (GB) is a machine learning technique for regression, which produces more accurate prediction models in form of ensemble weak prediction models. It is an iterative algorithm that combines simple parameterized functions with weak performance (high prediction error) in order to produce a highly accurate prediction by minimizing the errors [1]. Therefore, this paper investigates the application of gradient boosting algorithm in Generalised Linear Model (GLM) and Generalised Additive Models (GAM) to produce better prediction using Munich rental data. More interestingly, to compare the performance of classical GLM and GAM and their corresponding boosted packages in prediction. However, in boosting algorithm, optimum-boosting iterations are highly recommended to avoid over fitting. It plays an important role when the fitting model, we, therefore, employ the use of the Akaike Information Criterion (AIC) based technique to determine the appropriate boosting iteration that gives the optimum prediction. We applied the AIC and Cross-validation (CV) techniques to determine the optimum boosting iterations. The results obtained are then compared to investigate the algorithm that is more accurate. It is noticed that by default, the gamboost (boosted GAM) fits models using smooth baselearners (bbs). Similarly, it also noted that the coefficients of the fitted model will be in matrix form if smooth base-learners are used while they are just linear if linear base-learners are used.
Subjects
Mathematics & StatisticsAsk about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Review article · 19 Aug 2021
Preventing Internal Fraud In Microlending Business Processes with Machine Learning Models: Confirmatory Factor Analysis (CFA) and Extreme Gradient Boosting (XGBOOST)
Research article · 2010
Role of Statistical tests in Estimation of the Security of a New Encryption Algorithm
Research article · Aug 2014
Neural Network Training By Gradient Descent Algorithms: Application on the Solar Cell
Research article · Feb 2014
Synchronous Reference Frame Based Control of Switched Boost Inverter for Stand-Alone Dc Applications Using Genetic Algorithm
More from this journal
The newest in Research & Reviews: Journal of Statistics and Mathematical Sciences.
Editorial · 12 Jun 2025
Advanced Differentiation Techniques and their Applications Across Disciplines
Editorial · 12 Jun 2025
Applications and Implications of Probability Theory in Finance and Economics
Research article · 20 Apr 2025
Analysis of Inventory Coordination in Supply Chain with Price Dependentent in a Stochastic Demand
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalResearch & Reviews: Journal of Statistics and Mathematical Sciences
- SubjectMathematics & Statistics
- BylineArticles whose byline prints “Hamid A Adamu”
- BylineArticles whose byline prints “Murtala Muhammad”
- BylineArticles whose byline prints “Abdullahi Mohammed Jingi”
