After raping her, 50-years-old Kevin Gibbons then forced her to breastfeed him instead of the child, after delivery.
He was on Friday jailed for 25 years by a judge, who described him as "manipulative, controlling, obsessive and domineering", The Mirror reported.
Gibbons raped both women and imprisoned them after claiming he "lived by the word of God and practised his teachings", Liverpool Crown Court heard.
His first victim said she feels he "sucked the life out of (her)."
His other victim, who he raped while she was pregnant and just after she gave birth made her breastfeed him, mentioned that she had a breakdown and was for a time, suicidal. Also on one occasion, he forced her to have sex while he filmed it, before he threatened to reveal it to others.
His terrorising behaviour, which included stalking, came to light when by a twist of fate both women ended up living in the same street and the police learnt of their ordeals.
Besides his horrifying sex crimes, Gibbons's long sentence was also for false imprisonment and child abuse.
He was finally found guilty of 11 offences after a three-week trial.