I say drop him now.
No more chances.
From what you divulged already I don't believe it's a good plan to push and push. Not looking good for a future together.

Not easy and going to hurt you now, but not as much as it will continue to do in the future if you don't cut free and love your life.
He'll end up controlling you totally. Misery