Do you change a poop diaper when baby is sleeping?

I'm always so torn! On the one hand, I don't EVER want to wake up a baby that I've finally gotten to go to sleep. On the other hand, I don't want their sensitive little skin to get chafed! Which way do (or did) you usually fall - change the diaper, yes or no?