That a bit of a broad brush you're painting with based on the premise that customers require face-to-face contact and that work done can actually be outsourced to equally qualified and experienced individuals.

Take software engineering for example - the actual workers (the software engineers) rarely meet customers who themselves tend to be geographically remote. Let's not get into how outsourcing isn't the great money saver that outsiders think it is.

What I've found is that employers seem to demand workers in an office to give middle management something to do and to justify expensive yet unneeded office space. Outsourcing as you suggest would put them out of a job and not address the money wasted of managerial offices.