Structural vs. Parametric Uncertainty
Standard Bayesian inference assumes fixed model structure M.
But real uncertainty includes:
θ uncertainty (parameters)
M uncertainty (model form)
True posterior should be:
P(θ, M | D)
Model averaging:
P(θ | D) = Σₘ P(θ | Mₘ, D) P(Mₘ | D)
When Mₘ excludes the true structure:
All posteriors remain systematically biased.
Fundamental limit:
Inference cannot recover information that was never representable.
mkscienceset.com/articles_fi…
#BayesianModelAveraging #Uncertainty #ScientificMethod