Castor oil has been a medicine cabinet staple for generations, much like baking soda. Together, they may help to safely get rid of a bothersome skin tag. Mix two parts castor oil with one part baking soda and rub it gently over the skin tag. Cover with a piece of plastic wrap, or banana or papaya peel, and secure with a bandage. Leave on overnight and rinse off in the morning. Repeat nightly until the skin tag falls off.