Vitter, who voted against the deal that Congress and Obama ultimately approved, said he couldn't support the deal for three reasons.

First, he said the deal "simply didn't even begin to do nearly enough to put us on any sort of sustainable fiscal footing."

Secondly, Vitter said "there is no enforcement mechanism to make sure we stick" to the plan.

Lastly, he said the "trigger cuts" of the plan's second phase unfairly targeted defense spending rather than entitlement programs.

"From a motivation standpoint, I don't think that's going to scare or motivate liberals in Washington," Vitter said.

Vitter said getting the U.S.'s fiscal house in order entails cutting spending and reforming the tax code to "promote growth."

Vitter also discussed Obama's decision to halt the permitting process for drilling in the Gulf of Mexico in the wake of BP's disastrous well blowout.

He said he fought to ensure permitting would continue by putting holds on some of Obama's political appointees.

"I'll continue to look for any pressure point, any ability and any leverage to force the administration" to hasten the permitting process, Vitter said.