Experience with faces does affect our face recognition abilities, but not in the way you might expect.
Discovering a face specific regionwith fMRI
How early does face perception develop in childhood?
