## Yet another expression of Bernoulli distribution

The probability mass function of Bernoulli distribution is

Sort By Category

The probability mass function of Bernoulli distribution is

出発まで

We would like to minimize bugs when we write code. If we encounter errors, we know something is going wrong, but some serious bugs don’t stop the code.

We sometimes encounter the calculation of

We can replace normal multiple regression with Bayesian Multiple Regression.

Perplexity is commonly used to evaluate language models.

Log likelihood of Latent Dirichlet in Collapsed Gibbs Sampling.

Sigmoid function (standard logistic function) is defined as

Overflow problems are common in neural network-like structures.

If the data is large, we encounter overflow in sigmoid function.

Suppose we are doing Gaussian Mixture (1D). The histogram of posterior distribution is (we choose a new \(z_i\) from this histogram),

You may wonder why \(\log f(x) - {\rm exprand}(1)\) is the same as \(u \sim {\rm Uniform}(0, f(x))\).

This is not a smoothed LDA. The model is Beli, Ng, and Jordan (2003) Figure 1. You can find another useful derivation note.

Jekyll and Github Pages are great tools to create a website. I used minimal-mistakes template.

On This Page