Switch to a concealer that is made for acne-prone skin. Look for ingredients like salicylic acid or tea tree oil (these are excellent for drying pimples). I know The Body Shop has a tea tree oil concealer—check it out. 🙂