I removed the stickers off of several sets and I don't recommend it. They work fine, but they are sticky and leave a residue on the blocks. What I have done is bought some thin vinyl at Walmart and cut it to the size of the block. Put the vinyl on the block and smooth it out, then put your stamps on the vinyl side of the block to stamp. They cling well to that vinyl and your block stays nice too. Got that idea on SCS somewhere.