Big performance regression due to the space permission list filling up when getting space properties

In the new code that ensures space permissions are not missing, we are filling a list that should have been an ordered set. We need to use a set and to avoid this check when we know it's not needed anymore.