In the last two parts (part one, part two) we looked at the problem of entropy estimation and several popular estimators.
In this final article we will take a look at two Bayesian approaches to the problem.
This year we (Zoubin, together with David and myself) are again organizing a workshop event for the local Cambridge (UK) machine learning community. The schedule is available at the workshop homepage, Machine Learning in Cambridge 2015, and we also plan …
Estimation of the entropy of a random variable is an important problem that has many applications. If you can estimate entropy accurately, you can also estimate mutual information, which allows you to find dependent random variables in large data sets …
In December 2014, just in time for NIPS, MIT Press released an edited volume on structured prediction models and their applications in natural language processing, computer vision, and computational biology.
Advanced Structured Prediction, Editors Sebastian Nowozin, Peter V. Gehler, Jeremy …