A Conservative peer has hit out at "fake barber shops and taxi drivers" in a south Oxfordshire village.