Un upper bound for Kullback-Leibler divergence with a small number of outliers

Abstract

We establish a new upper bound for the Kullback-Leibler divergence
of two discrete probability distributions which are close in a sense that typically the ratio of probabilities is nearly one and the number of outliers is small.