Attempting to play the ball with your chest (which he admits he was) whilst having your arms away from your body is asking for trouble.
Type of decision (the sending off not the penalty) that could go either way so in my opinion the ref wasn't incorrect to send him off.