Republican U.S. Senate candidate Bob Hugin has spent his entire campaign in New Jersey distancing himself