yes, you can travel in any countries even if you're only holding a spouse visa, you just need to apply a visa to that certain country where you plan to travel.

i have travelled to germany & paris even if i dont have ILR yet, i just applied for a schengen visa, it was quick, no hassle & free of charge if you're a spouse of a British national or EU citizen.