Well, maybe his pants were never meant to be down in the first place...I mean, I don't think that Austin would want Mini-Me's but in his face so they were just going to pretend that his pants were down and hope that no one noticed.
The guy's a midget. He has small arms. He wouldn't have been able to reach his pants and pull them up as quickly as the scene needed him to. Give the guy a break!