News comes after departure of Treasury's acting Deputy Secretary David Lebryk after more than 30 years of service.