Many have travelled from Ireland to UK and visa versa by ferry. They were not checked for passports and no immigration officers, but my advice is do it right and properly. Always better safe than sorry.