Beyond the Big Apple lies hidden treasures like this Hudson Valley city, which boasts a vibrant downtown and access to outdoor experiences on the Delaware.