Old conquerors — and not belonging to island (7)

I haven't cracked this one yet — but the brilliant team at Times for the Times have:

NOR (and not) MAN’S (belonging to that isle)