You realize that when someone says 'white male' they are saying it in the context of other types of people in the same society? Ie we're still talking about the First World - just juxtaposing them to black males, asian females, white females, etc.

The existence of 5-odd billion non-white people around the world isn't really discussed :)