The correct answer is Department of the Treasury. It was made during the first year of President Washington's service and the first secretary of treasury was Alexander Hamilton. Secretary of Transportation was made around 50 years ago, while the Interior Department was made around 160 years ago. Labor Department was formed in 1913.
