MoreBeer and other websites have starter kits, usually in 3-4 price ranges. Sometimes the stuff the kits include are not necessary, but do make certain tasks easier.
I prefer 6 gal. glass carboys with the carrier loop on the neck. The plastic buckets also work, but you can't see inside. The plastic buckets are better for dry-hopping, though.
The Essential Kit (IMO):
I would recommend two buckets with 3-piece fermentation locks, holed and solid stoppers for each bucket, 6' of 3/8" vinyl tubing for siphoning, a mid-range hand-capper (one of those things that need to be reliable and consistent), tape-on thermometers for the buckets and a long one for the boiling pot, a large metal heat-resistant plastic spoon, and two fine-mesh bags - one for steeping grain and the other for steeping hops. The boiling pot needs to be *at least* 5 gal. capacity for partial-boil brewing and 8 gallons for full-boil. You can do it all in one bucket, but I highly recommend transferring the beer after a week of fermentation to the second bucket (called "racking to secondary).
A five gallon batch makes about 50 12-oz bottles or 30 22-oz bottles. 12-oz bottles are more work, but easier to share with friends.