Rewarding Mistakes

I often reward a dog that has made an error in training.  This is seriously counter intuitive, since most of us know that the way to increase a behavior is to reward it, and the way to decrease a behavior is to ignore or punish it.  So why on earth would I reward a...