This happened to me once and i paid the money only to find someone had sent me a card that was over the size for a normal 1st class stamp. Ironically, the person who sent it actually worked for the post office as a postman.
I think your right to let the post office keep it. They will just destroy it eventually.