Dontpushme:--
I just noticed that you are in USA. I cannot imagine that a person who has been allowed a visa for USA and did not break any laws or rules there would be refused one for UK.
The problems are for applicants from poor countries, with weak or no social and economics ties (good job, owner of property etc) who would have nothing to loose by not returning. The immigration want to as sure as they can be that a person granted a visa is not going to over stay or break the law.
As I said I cannot imagine how not using a visa would create any sort of obstacle to a new application. After all if they accepted you once why wouldn't they do so again?
I am sure many people would love to be in your position.