No one can tell you 'what you need to do'

BUT......... knowing what you have told us... you need to assess if he is the right person for you? Is he going to stand by you whatever happens in life? It appears he likes the 'unattached' feeling of the LDR while still having you at his beck and call when ever he needs you.

I think it is a cop-out saying that he comes from a broken family, just an excuse to stay the way he is.
I know what I would do... but I am not you .... and it is your decision