How To Remove Stubborn Labels From Jars - The Thrifty Squirrels First of all score the paper label a few times then soak the jar in water so that the paper can be removed. If the paper is really difficult to get off even after soaking then I find a scouring sponge rubbed gently over the label will take it off. Then all you need are two very basic ingredients; vegetable oil and bicarbonate of soda.