Nội dung text [AI '24-6] Final Revision - Part 2.pdf
Artificial Intelligence Final Revision Part 2
Decision Trees (ID3 Algorithm) Gain of Outlook ?
9 Yes, 5 No 2 Yes, 3 No 4 Yes, 0 No 3 Yes, 2 No = 0 = 0.97 = 0.97 Outlook Overcast Sunny Rain 2 yes / 3 no 4 yes / 0 no 3 yes / 2 no 9 yes / 5 no Entropy(S) = ∑ – p(I) . log2p(I) (Given) Gain(S, A) = Entropy(S) – ∑ [ p(S|A) . Entropy(S|A) ] #note: Entropy of pure = Zero, Entropy of Impure = 1
English