The “hostile environment” of the Windrush Scandal isn’t the first time the British Caribbean community has had to fight to be seen as British.