As with any large gathering involving people, you'll get the odd fight, not unusual at sporting events. As for top hats, you are not allowed on the track without one, and if you are seen without by a steward they will ask you to put it back on or leave the track.