Understanding Cross-entropy for Machine Learning
Aug 10, 2021 · Now, entropy is the theoretical minimum average size and the cross-entropy is higher than or equal to the entropy but not less than that. To sum it up, entropy is the optimal distribution that we want to get on our output. However, we get some other distribution – Cross-entropy, which is always larger that entropy.
DA: 87 PA: 3 MOZ Rank: 50