I hate to submit a slip-up for my favorite movie ever, but here goes!
Right after they get out of the fire swamp, Westley gets captured by Count Rugen, notices that he has six fingers and tells him that "someone was looking for you." Then, of course, he gets clobbered and thrown into the Pit of Despair with the albino. Meanwhile, Fezzik and Inigo reunite and Fezzik is trying to nurse Inigo's hangover with the hot and cold water. As he is feeding him stew the grandpa/narrator tells of the discovery of the six fingered man, at which time Inigo does a face plant into his bowl. But, with Westley in the Pit of Despair, there was no way they could have known! They had no contact with Westley from the moment he kicked their butts, and Fezzik was working for Yellin (the red-haired guy that was ordered to form the brute squad) and Yellin would not have occation to mention that his boss, the Count, has six fingers. Also, judging by the reaction the count gave Westley upon his observance, I'm sure he was not too friendly with people that threw around his physical abnormality as if it were common knowledge. I'm sure someone out there will come up with a plausible explanation, but it just doesn't make much sense to me :)