A random variable X has a probability distribution as X a b C P(X) = |p(x) 1/4 1/2 1/4] It is correlated with the other random variable Y(0,1). Their relation can be |X\Y 1 1/2 1/2 a described by conditional probability matrix P(Y/X) = b 2/3 1/3 1/4 3/4

Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter3: Matrices
Section3.7: Applications
Problem 14EQ
icon
Related questions
Question
A random variable X has a probability
distribution
as
X
P(X) = D6
a
C
p(x) 1/4 1/2 1/4]
It is correlated with the other random variable Y(0,1).
Their relation can be
X\Y
1/2 1/2
2/3 1/3
1/4 3/4
1
a
described by conditional probability matrix P(Y/X) =
b
%3D
Transcribed Image Text:A random variable X has a probability distribution as X P(X) = D6 a C p(x) 1/4 1/2 1/4] It is correlated with the other random variable Y(0,1). Their relation can be X\Y 1/2 1/2 2/3 1/3 1/4 3/4 1 a described by conditional probability matrix P(Y/X) = b %3D
1) calculate its entropy, H(X).
2) calculate P(Y) and entropy of Y, H(Y).
3) calculate the joint and conditional entropy H(XY) and H(Y/X).
4) calculate the mutual information I(X,Y).
5) calculate the conditional entropy H(X/Y).
Transcribed Image Text:1) calculate its entropy, H(X). 2) calculate P(Y) and entropy of Y, H(Y). 3) calculate the joint and conditional entropy H(XY) and H(Y/X). 4) calculate the mutual information I(X,Y). 5) calculate the conditional entropy H(X/Y).
Expert Solution
steps

Step by step

Solved in 4 steps

Blurred answer
Knowledge Booster
Markov Processes and Markov chain
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, advanced-math and related others by exploring similar questions and additional content below.
Similar questions
  • SEE MORE QUESTIONS
Recommended textbooks for you
Linear Algebra: A Modern Introduction
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Algebra & Trigonometry with Analytic Geometry
Algebra & Trigonometry with Analytic Geometry
Algebra
ISBN:
9781133382119
Author:
Swokowski
Publisher:
Cengage