What makes these different from many other offices in the executive branch is that the president usually cannot remove the department heads from office.

Executive Office of the President

Vice President's Office

Independent Regulatory Agencies