Since being with my long-term partner I have come to faith. However, our relationship has turned sour as I want to formally get married and he does not. He is also dismissive of my faith and desire to be baptized. I don't want his negative influence on our children, but at the same time I don't want him to be absent from their lives. How can I progress in my faith while in this relationship?
We rejoice to hear you have come to faith in our Lord Christ, and wish to advise you that the Bible is very clear on how someone in your situation should proceed. Paul says this:
Since you are believing and your common-law husband is unbelieving, you fit the situation Paul describes perfectly. And Paul says to you that as long as your husband consents to live with you, you must remain faithful to him and not send him away or leave him.
On the other hand, you must also pursue your relationship with Christ without hesitation, and regardless of how he responds. You must get baptized, you must study the Bible, you must attend a Bible-based church regularly, etc, because these things are your faithful response to the Lord Who has saved you. As Paul says:
If your husband determines that your pursuit of Christ is intolerable to him and he decides to leave you, then Paul says you must let him go. Although you desire his affection and his place as father in your family, the word of God says it would be better for you and the children to let him go, than to entice him to stay at the expense of your obedience to Christ. Your obedience to Christ is more important than fellowship with your husband. Moreover, your obedience to Christ is also the most important witness you can give to your children, and it has eternal consequences for you and them.
So remain faithful to your husband in the hope the Lord may use your testimony to bring him to faith also, but if he decides to leave you because of your relationship with Christ, let him go so you may remain faithful to Jesus.