The billionaire's departure comes after he criticized a major spending bill. But the so-called DOGE and its efforts to restructure and shrink the federal government seem likely to remain.