I don't think anyone likes to be told they're wrong. But you're right, there is nothing that could offend someone as easily as something that personal.

They do it often enough, I think. What tends to be rare is when no one else can tell you're affected, either.