In Knoxville there is Scrapbooks and More (LSS) which has a pretty good stamping section. There is also a JoAnns, Hobby Lobby and Michaels all within about 2 miles of the Scrapbooks and More store.
http://www.scrapbooksandmore.readywe....com/home.html
Atlanta - I don't know of any LSSs, but they have a couple of Archivers in the area - I am not sure how far off of I-75 the Marrietta one is... the Gwinnett one is pretty far off 75.
ETA: On the directions for Scrapbooks and More it talks about I-40. I 40 and I-75 are the same road through that area.