Firstly, I would tell him to please stop whilst you are away - and give him your reasons. Tell him it is so tough that you are far apart - and this is not helping.
However, what I would say is that I think there is nothing happening here. Why? Because, if there was - he wouldn't allow you to find out.
