Hey Spencer,
When I first went into business, I spent every penny of my savings, and even borrowed more money to cover my initial equipment. It's not a cheap field to get into, especially if you want to be your own boss, but it's not impossible.
For you, if getting started professionally on a shoestring is your goal, it might be worth your while to invest in one nicer camera (possibly a Canon GL-2 or Sony VX2100) and a decent tripod. For the tripod, I highly suggest a beefy set of sticks and a Bogen/Manfrotto 503 head, but if that's out of the budget, the 501 head is surprisingly smooth for it's price (though not near the 503 in terms of fluid movement). Get a lighting kit that can give you a nice soft three point lighting setup. Finally, buy a decent boom mic and the cabling to get you connected.
At that point, you have just about everything you need to do non-live events. That means no weddings, court hearings, or anything live. To pull that off, you would still need at least a couple more cameras. But non live stuff, like band videos, TV commercials, or anything that can be re-shot in multiple takes is totally fine with that setup.
Ultimately, you're looking at about a $4000 investment, give or take, and of course, you do want to set a little bit aside for marketing as well.
A word of warning though: Understand that in the beginning you will probably make very little money. Most of us started off by giving out free work for a while, just to build up a decent demo reel. You may need to do the same before anyone will hire you. Also, you need to be good. Good, as in as good as the competition. Otherwise, you'll have a tough time getting customers.