Kullback–Leibler Divergence: Measuring How Distributions Differ
When working with probability, you often need to compare two distributions: one that represents reality (or observed data) and another that represents your assumptions (or a model). Kullback–Leibler (KL) Divergence is a standard way to quantify how different one probability distribution is from a second “reference” distribution. In practical machine learning, KL divergence turns up […]