Use a nipple brush. You can't just soak them or rinse. After using the nipple brush sterilize it once all the mold is out. And, don't store them in a bag or anything still wet or they will get moldy, especially if you have a lot of humidity in your house.