Ah, you evil people. You are getting my hopes up again. 
- I spoke to an advisor and he said to just go for it. I assume that he had his fee in mind just a little bit, though... He admitted later that it would just be a punt.
- But... The family permit referenced above refers to paragraph 295A, which states:
"(ii) any previous marriage or civil partnership (or similar relationship) by either partner has permanently broken down; "
No word about divorce or annulment. Huh. I always assumed that divorce or annulment was implied, but then why word it like above?
Got an appointment with the advisor on Thursday, there we'll go into more detail (but we're going to do the application ourselves, a real fee is too much for a punt), and then we'll just go for it.