According to Baldoni, he was "summoned" to the couple's New York City apartment to discuss changes ... comes weeks after he sued the New York Times over accusations the publication worked with ...