the longer you leave it the harder it gets, TELL HIM.
When you tell him im sure he will be ok, you should also tell him that you contacted this forum to show him how worried you are. He might even decide to disclose his knowledge about your previous refusal in the supporting letter rather than the ECO questioning you both about it, the past is the past but important info like this should not be kept secret. you owe it to him.
sammy.
good luck