Posterior for the Bernoulli using the Conjugate Prior | with example in TensorFlow Probability
Machine Learning & Simulation Machine Learning & Simulation
23.5K subscribers
1,516 views
33

 Published On Mar 21, 2021

If we observe data on the event modelled by a Bernoulli distribution, we could be interested in finding a posterior distribution over the latent parameter to it. If we use a conjugate prior, this posterior has a closed-form solution. Here are the notes: https://raw.githubusercontent.com/Cey...

The Bernoulli distribution is actually one of these rare cases in which we can actually express all associated distributions: The marginal, the posterior and the predictive posterior. Other more sophisticated distributions do not allow for this since we there run into the trouble of intractability when applying Bayes' rule.

-------

đź“ť : Check out the GitHub Repository of the channel, where I upload all the handwritten notes and source-code files (contributions are very welcome): https://github.com/Ceyron/machine-lea...

📢 : Follow me on LinkedIn or Twitter for updates on the channel and other cool Machine Learning & Simulation stuff:   / felix-koehler   and   / felix_m_koehler  

💸 : If you want to support my work on the channel, you can become a Patreon here:   / mlsim  

-------

Timestamps
00:00 Opening
00:16 Task of inferring parameters from data
01:30 Graphical Model and joint
04:10 Deriving the Posterior
11:20 A conjugate prior
11:55 TensorFlow Probability
15:25 End-Card

show more

Share/Embed