You only need one referee for the passport, and they could be one you used previously for naturalisation though it is different requirements. For naturalisation one referee needs to be a professional person (doesn't need to be British), and the other one needs to be a British passport holder (doesn't need to be a professional). Where for a passport the referee needs to be both a professional and a British passport holder.