Look aprilmaejon ..You either trust him or you dont.. If you dont then there lies the problem..One way or the other it needs to be resolved di ba?
Just be straight with him and see what he says..
Tell us what you feel after that conversation if you wish..