Removing Labels from Glass Jars and Bottles - Poofy Cheeks Hot water tub, fill bottles with hot water & drop in. Add baking soda, dish soap, white vinegar (careful with the vinegar as it will bubble up like a Junior High School volcano! Add little at a time). The labels peel right off for the most part. Ones that don't, scrape off easily, but do leave the glue residue behind.