Only compute specializes query if (min)specialization is enabled in the crate of the specializing impl

Only compute specializes query if (min)specialization is enabled in the crate of the specializing impl #126227