Watch the first scene where the cops are jumping from roof to roof. Watch the fat boy hit the bricks, and you will see the wall shake. Never seen a brick wall shake like that!
If you watch the "Making the Matrix" at the end of the DVD, you see a backdrop being pulled across the set several times. This could be why the bricks shake.