Responsibility is on Milan players