Yes, Congress could use budgetary process (power of the purse) in order to control federal bureaucracy.
Through the power of the purse, Congress could determine that amount of money that should be allocated to certain Federal programs.
If the congress intended to eliminate a certain program, all they have to do is simply cut down the budget for that program.
