I would strike up a conversation with the guy and see what happens. Unless you can see he's a gun totin' kidnappin' type then surely he's just looking to pickpocket or rob your necklace/watch? (and with your experience I'm sure you're not displaying any bling).

Perhaps he wanted to touch a pale person? I've seen that before.