We have to clear both at the same time. I think it makes sense to consider this part of the "separate alpha" flag, since alpha has to match both color and depth.