i(x,y) = h(x) + h(y) - h(x,y) - information one variable provides about another - h(x,y) is the joint entropy of x and y
i(x,y) = h(x) + h(y) - h(x,y) - information one variable provides about another - h(x,y) is the joint entropy of x and y
measure of reduction of entropy in variable x given a variable y i(x,y) = h(y) - h(x|y)