Make sure you have the saddle adjusted at the correct height and angle. Warm up slowly and pedal at a high cadence with just enough resistance to get your breathing to the point where you can still talk but not sing. If you just started take shorter sessions until you get use to the saddle.
http://bicycletutor.com/adjust-seat/
http://bicycletutor.com/adjust-seat/