Oral thrush is a very common yeast infection in babies. It causes irritation in and around a baby's mouth.