I have a pretty large collection, and I store mine upright in plastic DVD storage drawers - I'm not home, and this is the only picture I could find to share - do you see the drawers under the desk behind my watermark?
If you don't have many, you can stack them, but if they get too heavy the rubber starts pressing into the foam above it in the stack, and the impression makes the foam not cling as well to the block.