When Tom Cruise first visits the Manor House where the orgy takes place he arrives in a taxi coming from right to left, but note...when he retraces his steps to find the Manor House he arrives during the day in his jeep, coming from Left to Right. I'm not sure if this is a slip up but it looks wrong to me.
Maybe Tom's character only knew the general area of the house and therefore, drove around in circles looking for the exact spot and ended up driving to it in a different direction. I think we've all done that at some point when we're looking for a location we haven't been to many times and I know that I've ended up arriving in a different direction on many occasions.