Yup, it's quite simple if the immigration office doesn't think you are a genuine visitor and are in fact trying to settle here they can refuse you, and then no more visitor visas.
Is there anything you can do to make it look like it's a visit only (not working or trying to settle) if you want to come back after say 6 weeks after leaving UK on a six month tourist visa?