-In the good old days (sixties, presumably also earlier) police forces in at least some countries had phone books sorted both by address and by number.

(Source - flea market find, a Norwegian book on the state of the art in criminology, published c. 1965)

Edit: Oh, I just remembered that locally, the athletic union published a phone book with all subscribers in the municipality listed by number.

This was c.1990 - after call ID was an option if you bought a decoder (or was an ISDN subscriber), before Internet phone directories were a thing.