Closed-Form Derivation of Cross-Entropy Between Gaussian Distributions December 9, 2021 2 min readMachine Learning Mathematics
Moments in Statistics: Characterizing Probability Distributions May 27, 2021 2 min readStatistics Machine Learning
Cross-Entropy Method: A Practical Monte Carlo Optimization Technique March 29, 2021 3 min readMachine Learning Optimization Monte Carlo Method
Variational Autoencoder (VAE) March 18, 2021 4 min readBayesian Statistics Machine Learning Deep Learning
The EM Algorithm (2): Evidence Lower Bound and KL Divergence March 17, 2021 2 min readBayesian Statistics Machine Learning
The Binomial Distribution and Related Distributions March 16, 2021 2 min readStatistics Machine Learning
Maximum Likelihood Estimation for the Normal Distribution March 16, 2021 3 min readStatistics Machine Learning
Basic Terminology in Statistics and Machine Learning March 15, 2021 2 min readStatistics Machine Learning
Unscented Transformation: Algorithm and Python Implementation January 25, 2021 4 min readMachine Learning Filtering Python
Training Neural Networks with Genetic Algorithms in Python January 9, 2021 5 min readSwarm Intelligence Machine Learning Python
Bayesian Linear Regression: From Least Squares to Bayesian Estimation January 8, 2021 5 min readBayesian Statistics Machine Learning Python
Fundamentals of Information Theory: From Entropy to Mutual Information (PRML 1.6) January 7, 2021 4 min readMachine Learning Information Theory