Scholars Central

Research articlePublished 2019

Application of Gradient Boosting Algorithm In Statistical Modelling

Authors: Hamid A Adamu, Murtala Muhammad, Abdullahi Mohammed Jingi

Ask about this article

Abstract

Select any words in the title or abstract, or press this and choose a sentence.

Gradient Boosting (GB) is a machine learning technique for regression, which produces more accurate prediction models in form of ensemble weak prediction models. It is an iterative algorithm that combines simple parameterized functions with weak performance (high prediction error) in order to produce a highly accurate prediction by minimizing the errors [1]. Therefore, this paper investigates the application of gradient boosting algorithm in Generalised Linear Model (GLM) and Generalised Additive Models (GAM) to produce better prediction using Munich rental data. More interestingly, to compare the performance of classical GLM and GAM and their corresponding boosted packages in prediction. However, in boosting algorithm, optimum-boosting iterations are highly recommended to avoid over fitting. It plays an important role when the fitting model, we, therefore, employ the use of the Akaike Information Criterion (AIC) based technique to determine the appropriate boosting iteration that gives the optimum prediction. We applied the AIC and Cross-validation (CV) techniques to determine the optimum boosting iterations. The results obtained are then compared to investigate the algorithm that is more accurate. It is noticed that by default, the gamboost (boosted GAM) fits models using smooth baselearners (bbs). Similarly, it also noted that the coefficients of the fitted model will be in matrix form if smooth base-learners are used while they are just linear if linear base-learners are used.

Ask about this article

Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.

Try:

Similar by topic

More from this journal

The newest in Research & Reviews: Journal of Statistics and Mathematical Sciences.

All its articles

Follow

New articles from what you follow go into your email digest, once you agree to alert emails.

  • JournalResearch & Reviews: Journal of Statistics and Mathematical Sciences
  • SubjectMathematics & Statistics
  • BylineArticles whose byline prints “Hamid A Adamu”
  • BylineArticles whose byline prints “Murtala Muhammad”
  • BylineArticles whose byline prints “Abdullahi Mohammed Jingi”

For authors and organisers

Publish, present and keep up with your field

Find the right journal for your paper and submit your manuscript.

Photo: Pexels