Thank you all for your advice. I was unable to purchase the EZ foam in my part of California, so I opted for the Aileen's. Boy that stuff sure does stick. It's nice to hear others of you have had this problem. I only wish I had tried this method out and then had written the forum before I did this to almost all of my stamps.
I will try the rubbing on my sweatshirt idea. If that fails then I will be spending all night taking all of the rubber off of my stamps. May I ask how all of you store your rubber stamps. I thought putting them on the white plastic board was a great idea and then the binder; easy storage and being able to see what stamp you have and it being readily being available without hunting through my drawers.
Thanks all who responded. Now I know my stamps can be saved!!!!!