I know how you feel Penny, but do not lose hope, anyway as you said as long as you are both happy together.
Just keep trying, I have friends whose been married for more than ten years and no luck to have their own baby, so they adopt a baby girl from distant relative. And guess what, after 6 years, her prayer finally granted and they have baby boy and she was 45 years old when she got pregnant.