GLOBAL KNOWLEDGE ARK

Cosmology · Cosmological parameters and statistical inference

Likelihoods, priors and posterior distributions

Normalize a three-trial count under two explicit priors and distinguish density, range probability, mean and mode.

Preparation: ratios, powers of ten and ordinary arithmetic. Physical quantities and notation are introduced as they are needed.

Back to the chapter

After reading, you can

  • Define a likelihood for a specified count event.
  • Normalize two proper posterior distributions.
  • Separate probability density from integrated probability and estimator summaries.
01

A likelihood is a response to a parameter choice

A sampling model assigns probabilities to possible observations for a fixed parameter. Once an observation is supplied, its likelihood is that same expression considered as a function of the parameter.

The likelihood need not integrate to one over the parameter. Its normalization as a sampling distribution concerns possible data at each fixed parameter value.

A Bayesian posterior also uses a prior distribution over the declared parameter space. The posterior is proportional to likelihood times prior, with the normalizing evidence obtained by integrating that product.

These definitions are useful in cosmology, where a probability model connects physical predictions and observational responses. The small count below is hypothetical and supplies no astronomical observations.

02

The observed event determines the combinatorial factor

Let θ lie in [0,1] and denote the success probability in three independent, identically distributed Bernoulli trials. Assume fixed perfect selection and supply the count K = 2 successes.

The count can arise from three ordered sequences. Its likelihood is L(θ;K=2) = 3θ²(1−θ), where the factor 3 counts those possibilities.

This is a probability of the specified count for each θ. It differs from the likelihood of one particular ordered sequence with two successes, which lacks that factor.

Compare two explicitly normalized priors: a uniform density π₁(θ) = 1, and π₂(θ) = 6θ(1−θ), both on [0,1]. The latter is often named Beta(2,2); the polynomial defines it completely.

03

The same data can update different priors

For the uniform prior, the evidence is Z₁ = ∫₀¹3θ²(1−θ)dθ = 1/4. Dividing by it gives p₁(θ|K=2) = 12θ²(1−θ).

For the second prior, the likelihood-prior product is 18θ³(1−θ)². Its integral is Z₂ = 3/10, giving p₂(θ|K=2) = 60θ³(1−θ)².

Each posterior density integrates to one. Their compact names are Beta(3,2) and Beta(4,3), but no special-function notation is needed to use the explicit formulas.

The evidences are prior-predictive probabilities of the count K = 2 under the two assumptions. They are not posterior probabilities that either prior is true.

Hypothetical K = 2 of n = 3; posterior columns are densities per unit θ, while L is a count probability
θL(θ)Uniform-prior posteriorBeta(2,2)-prior posterior
0000
0.250.1406250.56250.527344
0.50.3751.51.875
0.750.4218751.68751.582031
1000
04

Density height is different from probability mass

For a continuous parameter, the posterior probability of a range is the area under its density over that range. The probability of one exact point is zero under these continuous posteriors.

The first posterior has cumulative distribution F₁(θ) = 4θ³−3θ⁴. Thus P₁(θ>1/2|K=2) = 1−F₁(1/2) = 11/16 = 0.6875.

Its density at θ = 1/2 is 1.5 per unit θ. A density may exceed one because a density height is not itself a probability; a properly integrated probability remains between zero and one.

The second posterior gives P₂(θ>1/2|K=2) = 21/32 = 0.65625. The difference traces an explicit prior choice rather than a change in the supplied count.

05

A single best value does not describe the whole inference

The first posterior mean is 3/5 and its mode is 2/3. For the second, the mean is 4/7 and the mode is 3/5. A mean and a density maximum answer different questions.

A posterior range or summary remains conditional on the declared trial model, prior, selection and observation. More complicated cosmological likelihoods also require physical predictions and observational nuisance models.

The count normalization can be checked separately: the four prior-predictive probabilities for K = 0,1,2,3 are (1/4,1/4,1/4,1/4) under the uniform prior and (1/5,3/10,3/10,1/5) under the second. Each list sums to one.

Posterior content is not automatically the repeated-sampling coverage of a confidence procedure. Keep the data model, prior, normalization and interpretation visible when reporting a parameter estimate.

Likelihood probability and two normalized posterior densitiesThe same hypothetical count K = 2 from three independent Bernoulli trials with dimensionless success probability θ is shown on three separate panels. Selection is fixed and perfect. Panel A has horizontal θ from 0 to 1 and vertical count probability from 0 to 0.5. Its green solid curve and diamond samples give L = 3θ²(1−θ). Panel B instead has posterior density per unit θ from 0 to 2.5 for a uniform prior, p₁ = 12θ²(1−θ), drawn solid blue. Its diagonally hatched area above θ = 1/2 is 11/16, whereas the filled circle at θ = 1/2 has density height 1.5. Panel C has the same density scale for proper prior 6θ(1−θ), giving dashed orange p₂ = 60θ³(1−θ)². Oppositely directed hatching marks tail area 21/32 above θ = 1/2; the filled square there has height 1.875. Every posterior has total area 1; likelihood need not integrate to 1 over θ. Evidences are 1/4 and 3/10. The corresponding posterior means are 3/5 and 4/7, while modes are 2/3 and 3/5. A continuous point has zero posterior probability here; density height is not a range probability. All numbers are supplied teaching mathematics rather than observations.Probability is area, not density heightSupplied count: K = 2 successes from 3 independent trials.θ is dimensionless; selection is fixed and perfect.The same count is updated under two stated proper priors.A · Count likelihood L = 3θ²(1−θ)00.10.20.30.40.500.250.50.751Horizontal θ · vertical count probability P(K = 2 | θ)B · Uniform prior: posterior p₁ = 12θ²(1−θ)Area θ > 1/2 = 11/16. Height at 1/2 = 1.5 per unit θ.00.511.522.500.250.50.751Horizontal θ · vertical posterior density per unit θC · Prior 6θ(1−θ): posterior p₂ = 60θ³(1−θ)²Area θ > 1/2 = 21/32. Density at 1/2 = 1.875.00.511.522.500.250.50.751Horizontal θ · vertical posterior density per unit θEach posterior has total area 1; likelihood area need not be 1.Means: 3/5 and 4/7. Modes: 2/3 and 3/5.These are hypothetical probabilities, not astronomical data.
The same hypothetical count K = 2 from three independent Bernoulli trials with dimensionless success probability θ is shown on three separate panels. Selection is fixed and perfect. Panel A has horizontal θ from 0 to 1 and vertical count probability from 0 to 0.5. Its green solid curve and diamond samples give L = 3θ²(1−θ). Panel B instead has posterior density per unit θ from 0 to 2.5 for a uniform prior, p₁ = 12θ²(1−θ), drawn solid blue. Its diagonally hatched area above θ = 1/2 is 11/16, whereas the filled circle at θ = 1/2 has density height 1.5. Panel C has the same density scale for proper prior 6θ(1−θ), giving dashed orange p₂ = 60θ³(1−θ)². Oppositely directed hatching marks tail area 21/32 above θ = 1/2; the filled square there has height 1.875. Every posterior has total area 1; likelihood need not integrate to 1 over θ. Evidences are 1/4 and 3/10. The corresponding posterior means are 3/5 and 4/7, while modes are 2/3 and 3/5. A continuous point has zero posterior probability here; density height is not a range probability. All numbers are supplied teaching mathematics rather than observations. Original Ark teaching model.

Worked reasoning

Compute a range probability

Under the uniform prior, is the posterior probability θ>1/2 equal to its density at 1/2?

  1. Normalize the count likelihood by Z₁ = 1/4 to obtain 12θ²(1−θ).
  2. Integrate with cumulative distribution 4θ³−3θ⁴ from 1/2 to 1.
  3. Obtain 11/16 = 0.6875, distinct from density 1.5 per unit θ at 1/2.

No. Probability is integrated density over the stated range.

Try the reasoning

  1. Why does the likelihood for K = 2 contain the factor 3?

    Show the answer and reasoning

    Three ordered trial sequences have two successes.

    The observation is the count, so their probabilities are added.

  2. What normalizes likelihood times prior?

    Show the answer and reasoning

    The evidence, integrated over the declared parameter space.

    For the uniform prior here it is 1/4; for 6θ(1−θ) it is 3/10.

  3. Does a posterior density of 1.875 violate probability normalization?

    Show the answer and reasoning

    No.

    The value is a density per unit θ; its integral over the full allowed range is one.

What to carry forward

  • A likelihood fixes the observed event and is not a normalized parameter density.
  • Posterior normalization and shape depend on the declared prior.
  • Range probabilities, density maxima and posterior means carry different meanings.

References

Sources supporting the explanations, physical distinctions and examples in this lesson.

  1. Review of Particle Physics: 40. StatisticsG. Cowan; L. ListaTeaching resource · PDFpdg.lbl.govRead source