No one's opinion gonna matter and it's no match for the word of Yahweh.
Here's what Paul says in I Cor 7
12 But to the rest I say, not our Master, if any brother has an unbelieving wife, and she consents to live with him, let him not leave her.
13 And a woman who has an unbelieving husband, and he consents to live with her, let her not leave him.
14 For the unbelieving husband has been sanctified (made holy) by the wife, and the unbelieving wife has been sanctified by the husband; else, then, your children are impure, but in such cases they are pure.
15 But if the unbelieving one separates, let them be separated; the brother or the sister is not in bondage in such matters; but YAHWEH has called us in peace.
16 For what do you know, wife, whether you will save the husband? Or what do you know, husband, whether you will save the wife?
If someone comes to faith and their spouse does not, then they are to simply trust Yahweh and have patience in the relationship for Yahweh to work. In your case it worked, so be in peace. However, if the unconverted spouse were to leave their husband/wife on their own, there is nothing the converted spouse can do about it, and Yahweh says they are not in bondage in such a case. This is the only case where Bible allows divorce whereas in all other case Bible does not at all support divorce and re-marriage even if the other spouse caught in fornication.