Research article · 7 Jun 2022
Research articlePublished May 2010
On the Relation between Generalized Entropy and the Bayes Decision Error
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
We deal with the relation between the generalized entropy ( f -entropy, a family of functions that include several biodiversity measures) of a discrete random variable and the minimal probability of error (Bayes error) when the value of this random variable is estimated. Namely the tightness of their relation is studied. Morales and Vajda [1] recently introduced a measure called average inaccuracy that aims to quantify the tightness of the relation between the posterior Bayes error and the power entropies. It is defined as a standardized average difference between the upper and the lower bound for the posterior Bayes error under given entropy. Their concept can be generalized to any strictly concave f -entropy and used to evaluate its relation to the Bayes probability of error. However, due to a complex form of the formula of the average inaccuracy, it is difficult to compare the average inaccuracies of most f -entropies analytically. We propose a smooth approximation of the lower bound for the posterior Bayes error under given f -entropy that simplifies the formula of the average inaccuracy. We show that under this approximation, the quadratic entropy has the tightest relation to the posterior Bayes error among f - entropies. The quadratic entropy has the tightest relation to the posterior Bayes error (in the sense described in this paper) than the Shannon's entropy and other functions that belong to the family of f -entropies, like Emlen's index, Ferreri's index and Good's index.
Keywords
Subjects
Computer Science & ITAsk about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Research article · 2017
Economic Rationality-based Entrepreneurial vs. Employee Orientations by Entropy, Updating and Error Rates Computing: Evidence of Kenyan Credit Unions
Conference abstract · 19 Dec 2014
Preoperative paracetamol infusion reduces sevoflurane consumption during thyroidectomy under general anesthesia with spectral entropy monitoring
Research article · 2015
Entropy Based Multi-criteria Decision Making Method under Fuzzy Environment and Unknown Attribute Weights
Opinion · 31 Jan 2023
A Mathematical Relation Between Time And Entropy
More from this journal
The newest in European Journal of Biomedical Informatics.
Perspective · 31 Jan 2024
Insightful Perspectives: Harnessing Data Visualization for Breakthroughs in Biomedicine
Mini review · 31 Jan 2024
Unlocking Insights: The Crucial Role of Data Integration in Biomedicine
Review article · 30 Jan 2024
Revolutionizing Healthcare: The Power of Clinical Knowledge Management Systems
Conferences in this field
Upcoming conferences in this field.
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalEuropean Journal of Biomedical Informatics
- SubjectComputer Science & IT
- BylineArticles whose byline prints “Horáček M”
