Gibson said the U.S. should concentrate on more decisive military action.
"What we need to do is recognize the fact that al Qaeda declared war on us - we didn't declare war on them," he explained. "We need to take precision action against them - we don't need more big government."
Gibson said his observations are backed up by 24 years of active military service. Over the course of his 24-year Army career, which included four combat tours in Iraq, Gibson rose to the rank of Colonel.
Gibson's stance in terms of making cuts to the federal budget is in sharp contrast to his fellow Republicans running in New York's 23rd Congressional District - Saranac Lake accountant Doug Hoffman and Watertown businessman Matt Doheny.
During a recent debate, Hoffman and Doheny said they would cut into the deficit by eliminating Congressional earmarks.
But those earmarks make up a negligible chunk of the nation's spending. Defense, Medicaid and Medicare, and Social Security account for at least 60 percent of federal expenditures.
Gibson explained politicians need to start by thinking big and make the painful cuts, however unpopular they may be.
"We have to do it," he said. "What we need now is leadership. This is the first time since 1974 we have no budget - we've got no budget, because our leaders in Washington D.C. don't want to stand behind the hard choices that are necessary to move forward."
In his tour through the North Country, Gibson also said he would be seeking answers to the shortage of doctors in the Adirondacks region, a problem he said is likely to worsen without decisive action.
The federal government's caps on payments to general practitioners, soaring patient loads, and excessive awards in medical lawsuits are all contributing factors, he said.
Gibson supports repealing Obama's health-care bill but pursuing initiatives to reduce medical costs.
Gibson is running a close race with Murphy. The most recent poll numbers, offered up by a conservative organization, show Murphy with a slim five percentage point lead over the Kinderhook Republican.