Yes Pete did get together with Peggy the night before his wedding. It looks as if he is the father of the baby, she tells him this at the end of Series 2, however you just never know where this show is going.
What happened to the baby though? At the beginning at Series 2 we are invited into...