Hudson City Bank is the largest savings bank in New Jersey as well as one of the oldest banks in the USA with about $50 billion in assets. In 2007, Forbes ranked Hudson City Bank as the best bank. If you are trying to get in touch with a live customer service agent at Hudson City Bank continue reading below.