Here's what I use to clean my stamps:
Maybelline Eye Makeup Remover (frosty bottle w/blue cap) - about $3.50
Tap water (works just fine and is cheap)
Small spray bottle, about 8 oz
Pour half the makeup remover into the bottle. Fill with water. Turn bottle to combine, do not shake. Ready to use. When it's almost gone, repeat.