Allegri: 'It wasn't a punch'