Notes about statistical estimation of Shannon entropy
Abstract
We improve the method of Bulinski and Dimitrov (2019) to prove the $L^2$-consistency of the Kozachenko-Leonenko estimator for (differential) Shannon entropy.
Keywords
Shannon differential entropy, Nearest Neighbor graphs, Unbiasedness, Consis- tency, Kozachenko-Leonenko estimate, L 2 -consistency