A dataset showing the decisions about presence of Heart Disease (HD) based on four attributes (Age, Blood pressure, Cholesterol and Heart rate) is listed in the following table: Age BP CH HR HD Old Low Low Medium No Very old Low Medium Low Yes Old Medium Medium Medium No Old Low Low Low Yes Mild Low Low Medium Yes Very old High Medium Low Yes Very old Medium Medium Low Yes Mild Medium Very high Low Yes Old Low Medium Medium No Very old Medium Very high Medium No Very old Medium Low Medium No Mild Low Medium Medium No Mild Low Medium Medium No Compute the entropy for this data set. What is the information gain for the Heart Rate (HR) feature? Given a choice among Age, Blood pressure, Cholesterol and Heart rate, which feature would the ID3 algorithm choose as the root node for a decision tree. What is the role of information gain and entropy in ID3 algorithm

Computer Networking: A Top-Down Approach (7th Edition)
7th Edition
ISBN:9780133594140
Author:James Kurose, Keith Ross
Publisher:James Kurose, Keith Ross
Chapter1: Computer Networks And The Internet
Section: Chapter Questions
Problem R1RQ: What is the difference between a host and an end system? List several different types of end...
icon
Related questions
Question

Subject: Machine Learning

A dataset showing the decisions about presence of Heart Disease (HD) based on four attributes (Age, Blood pressure, Cholesterol and Heart rate) is listed in the following table:

Age

BP

CH

HR

HD

Old

Low

Low

Medium

No

Very old

Low

Medium

Low

Yes

Old

Medium

Medium

Medium

No

Old

Low

Low

Low

Yes

Mild

Low

Low

Medium

Yes

Very old

High

Medium

Low

Yes

Very old

Medium

Medium

Low

Yes

Mild

Medium

Very high

Low

Yes

Old

Low

Medium

Medium

No

Very old

Medium

Very high

Medium

No

Very old

Medium

Low

Medium

No

Mild

Low

Medium

Medium

No

Mild

Low

Medium

Medium

No

  1. Compute the entropy for this data set.
  2. What is the information gain for the Heart Rate (HR) feature?
  3. Given a choice among Age, Blood pressure, Cholesterol and Heart rate, which feature would the ID3 algorithm choose as the root node for a decision tree.
  4. What is the role of information gain and entropy in ID3 algorithm?
Expert Solution
steps

Step by step

Solved in 2 steps with 6 images

Blurred answer
Recommended textbooks for you
Computer Networking: A Top-Down Approach (7th Edi…
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Concepts of Database Management
Concepts of Database Management
Computer Engineering
ISBN:
9781337093422
Author:
Joy L. Starks, Philip J. Pratt, Mary Z. Last
Publisher:
Cengage Learning
Prelude to Programming
Prelude to Programming
Computer Engineering
ISBN:
9780133750423
Author:
VENIT, Stewart
Publisher:
Pearson Education
Sc Business Data Communications and Networking, T…
Sc Business Data Communications and Networking, T…
Computer Engineering
ISBN:
9781119368830
Author:
FITZGERALD
Publisher:
WILEY