Bagging is a poor man's Bayes!

This is from a talk of Trevor Hastie. Bagging or bootstrap aggregation averages a noisy fitted function refit to many bootstrap samples to reduce its variance.