I never said that businesses shouldn't have some sort of regulation. Obviously some businesses require more regulation than others; banks for instance need to be heavily regulated since they are dealing with a fiat currency and distributing value that doesn't really exist. The crash was also partially caused by the government forcing banks to give loans to people they otherwise would have rejected.
When I say to get government out of business I mean things like government created monopolies, no bid contracts, subsidies, revolving doors and corporations. Often times the government will create regulations against a particular type of business, but "grandfather in" current businesses - making it extremely difficult on potential competition. Big businesses LOVE government regulation.
Here are a few articles that lay out specific examples better than I could, and excerpts from each:
http://townhall.com/columnists/JohnStossel/2006/09/27/big_business_loves_government
http://www.cato.org/research/articles/cpr28n4-1.html
http://www.dailykos.com/story/2006/12/12/145645/59