A number is not a name until somebody looks it up, and looking it up is trivial. What the set contains is a contact graph.