He also said his administration will review whether certain authorities should be eliminated.
At a news conference, Christie signed an executive order that forbids authorities from signing new contracts with lobbying firms, and orders that existing contracts must expire or be legally terminated as soon as possible.
In making the rule, Christie blasted what he called "the shadow government economy," namely the work of around 700 state authorities, boards, agencies and commissions, whose members are not elected but administer large budgets.
"They spend billions of dollars every year of taxpayer money, fee-money, toll-money that is collected from the people of New Jersey and others. I have been... significantly disturbed by the reports of some of things we've seen going on, the ways that some of that money is expended."
The Press of Atlantic City reported on Monday that Christie vetoed budgets of the state thoroughbred and standardbred horse breeding associations in part because the thoroughbred group planned to spend $40,000 on lobbying.
The order further says that each authority must provide a list of all its lobbying contracts to the Governor's office by March 1.
And by May 15, each head of a government department must recommend to the governor which of the authorities in the department should survive. The governor said unnecessary authorities could be scrapped.
Christie specifically said the order extended to the two horsemen's associations, both registered as 501c3 non-profit organizations. As 501c3s, those groups are allowed to spend a small part of their budget on lobbying.
But Christie said he wanted to see those groups cease lobbying altogether.
"We're telling them not to be spending their money on lobbyists. And the tax code may have it be permissible, but this governor is not going to have it be permissible."
The governor on Tuesday also capped all travel by employees of the authorities at $250 unless otherwise approved by the governor's office.