See the Free Enterprise Fund v. PCAOB case from 2010 for reference of the issues involved.
The founding fathers would likely not recognize the “Administrative State” we live in today, but that ship has sailed—Agencies with some combination of Executive, Legislative, and Judicial powers are here to stay.