How frustrating! I'm sorry you're having a bad experience. Hope you have good luck getting your defective Bug replaced.
Initially, I had the same problem with that little screw coming out. After about the 6th time I screwed it in (just a bit tighter than I had before), it stayed. I have no idea why.