The most practical Bayesian counter (indep of matters of confidence) might be the info bottleneck:

  to generalize accurately, one must forget (irrelevant) details 

The risk (bottleneck) is in throwing out the relevant details