Table of Contents
- Overview
- How to set up constraints with Policy Library
- How to use Terraform Validator
- How to Use Forseti Config Validator
- End to end workflow with sample constraint
- Contact Info
As your business shifts towards an infrastructure-as-code workflow, security and cloud administrators are concerned about misconfigurations that may cause security and governance violations.
Cloud Administrators need to be able to put up guardrails that follow security best practices and help drive the environment towards programmatic security and governance while enabling developers to go fast.
Config Validator allows your administrators to enforce constraints that validate whether deployments can be provisioned while still enabling developers to move quickly within these safe guardrails. Validator accomplishes this through a three key components:
One way to define constraints
Constraints are defined so that they can work across an ecosystem of pre-deployment and monitoring tools. These constraints live in your organization's repository as the source of truth for your security and governance requirements. You can obtain constraints from the Policy Library, or build your own constraint templates.
Pre-deployment check
Check for constraint violations during pre-deployment and provide warnings or halt invalid deployments before they reach production. The pre-deployment logic that Config Validator uses will be built into a number of deployment tools. For details, check out Terraform Validator.
Ongoing monitoring
Frequently scan the platform for constraint violations and send notifications when a violation is found. The monitoring logic that Config Validator uses will be built into a number of monitoring tools. For details, check out Forseti Validator.
The following guide will walk you through initial setup steps and instructions on how to use Config Validator. By the end, you will have a proof-of-concept to experiment with and to build your foundation upon.
The Policy Library repository contains the following directories:
policiesconstraints: This is initially empty. You should place your constraint files here.templates: This directory contains pre-defined constraint templates.
validator: This directory contains the.regofiles and their associated unit tests. You do not need to touch this directory unless you intend to modify existing constraint templates or create new ones. Runningmake buildwill inline the Rego content in the corresponding constraint template files.
Google provides a sample repository with a set of pre-defined constraint templates. You can duplicate this repository into a private repository. First you should create a new private git repository. For example, if you use GitHub then you can use the GitHub UI. Then follow the steps below to get everything setup. If you are planning on using the Policy Library Sync feature of Forseti, then you should also add a read-only user to the private repository which will be used by Forseti.
This policy library can also be made public, but it is not recommended. By making your policy library public, it would be allowing others to see what you are and ARE NOT scanning for.
To run the following commands, you will need to configure git to connect securely. It is recommended to connect with SSH. Here is a helpful resource for learning about how this works, including steps to set this up for GitHub repositories; other providers offer this feature as well.
export GIT_REPO_ADDR="git@github.com:${YOUR_GITHUB_USERNAME}/policy-library.git"
git clone --bare https://github.com/forseti-security/policy-library.git
cd policy-library.git
git push --mirror ${GIT_REPO_ADDR}
cd ..
rm -rf policy-library.git
git clone ${GIT_REPO_ADDR}
Then you need to examine the available constraint templates inside the
templates directory. Pick the constraint templates that you wish to use,
create constraint YAML files corresponding to those templates, and place them
under policies/constraints. Commit the newly created constraint files to
your Git repository. For example, assuming you have created a Git repository
named "policy-library" under your GitHub account, you can use the following
commands to perform the initial commit:
cd policy-library
# Add new constraints...
git add --all
git commit -m "Initial commit of policy library constraints"
git push -u origin master
Periodically you should pull any changes from the public repository, which might contain new templates and Rego files.
git remote add public https://github.com/forseti-security/policy-library.git
git pull public master
git push origin master
The constraint template library only contains templates. Templates specify the constraint logic, and you must create constraints based on those templates in order to enforce them. Constraint parameters are defined as YAML files in the following format:
apiVersion: constraints.gatekeeper.sh/v1alpha1
kind: # place constraint template kind here
metadata:
name: # place constraint name here
spec:
severity: # low, medium, or high
match:
target: [] # put the constraint application target here
exclude: [] # optional, default is no exclusions
parameters: # put the parameters defined in constraint template here
The target field is specified in a path-like format. It
specifies where in the GCP resources hierarchy the constraint is to be applied.
For example:
| Target | Description |
| organization/* | All organizations |
| organization/123/* | Everything in organization 123 |
| organization/123/folder/* | Everything in organization 123 that is under a folder |
| organization/123/folder/456 | Everything in folder 456 in organization 123 |
| organization/123/folder/456/project/789 | Everything in project 789 in folder 456 in organization 123 |
The exclude field follows the same pattern and has
precedence over the target field. If a resource is in
both, it will be excluded.
The schema of the parameters field is defined in the
constraint template, using the
OpenAPI V3
schema. This is the same validation schema in Kubernetes's custom resource
definition. Every template contains a validation section
that looks like the following:
validation:
openAPIV3Schema:
properties:
mode:
type: string
instances:
type: array
items: string
According to the template above, the parameter field in the constraint file
should contain a string named mode and a string array named
instances. For example:
parameters:
mode: whitelist
instances:
- //compute.googleapis.com/projects/test-project/zones/us-east1-b/instances/one
- //compute.googleapis.com/projects/test-project/zones/us-east1-b/instances/two
These parameters specify that two VM instances may have external IP addresses. The are exempt from the constraint since they are whitelisted.
Here is a complete example of a sample external IP address constraint file:
apiVersion: constraints.gatekeeper.sh/v1alpha1
kind: GCPExternalIpAccessConstraintV1
metadata:
name: forbid-external-ip-whitelist
spec:
severity: high
match:
target: ["organization/*"]
parameters:
mode: "whitelist"
instances:
- //compute.googleapis.com/projects/test-project/zones/us-east1-b/instances/one
- //compute.googleapis.com/projects/test-project/zones/us-east1-b/instances/two
The released binaries are available under the gs://terraform-validator Google
Cloud Storage bucket for Linux, Windows, and Mac. They are organized by release
date, for example:
$ gsutil ls -r gs://terraform-validator/releases
...
gs://terraform-validator/releases/2019-04-04/terraform-validator-darwin-amd64
gs://terraform-validator/releases/2019-04-04/terraform-validator-linux-amd64
gs://terraform-validator/releases/2019-04-04/terraform-validator-windows-amd64
To download the binary, you need to
install the
gsutil tool first. The following command downloads the Linux version of
Terraform Validator from 2019-04-04 release to your local directory:
gsutil cp gs://terraform-validator/releases/2019-04-04/terraform-validator-linux-amd64 .
chmod 755 terraform-validator-linux-amd64
Currently only Terraform v0.11 is supported. These instructions assume you have forked a branch and is working locally.
Generate a Terraform plan for the current environment by running:
terraform plan -out=tfplan.tfplan
To validate the Terraform plan based on the constraints specified under your local policy library repository, run:
terraform-validator-linux-amd64 validate tfplan.tfplan --policy-path=${POLICY_PATH}
The policy-path flag is set to the local clone of your Git repository that contains the constraints and templates. This is described in the "How to set up constraints with Policy Library" section.
Terraform Validator also accepts an optional --project flag which is set to the Terraform Google provider project. See the provider docs for more info. If it is not set, Terraform Validator will attempt to parse the provider project from the provider configuration.
If violations are found, a list will be returned of the affected resources and a brief message about the violations:
Found Violations:
Constraint iam_domain_restriction on resource //cloudresourcemanager.googleapis.com/projects/299388503561: IAM policy for //cloudresourcemanager.googleapis.com/projects/299388503561 contains member from unexpected domain: user:foo@example.com
Constraint iam_domain_restriction on resource //cloudresourcemanager.googleapis.com/projects/299388503561: IAM policy for //cloudresourcemanager.googleapis.com/projects/299388503561 contains member from unexpected domain: group:bar@example.com
If all constraints are validated, the command will return "No violations found." You can then apply a plan locally on a development environment:
terraform apply
These instructions assume that the developer has merged their local branch back with master. We want to make sure the master deployment into production is validated.
In your continuous integration (CI) tool, you should install Terraform
validator. Then you can add a step to any workflow which will validate a
Terraform plan and reject it if violations are found. Terraform validator will
return a 2 exit code if violations are found or 0 if no violations were
found. Therefore, you should configure your CI to only proceed to the next step
(for example, terraform apply) or merge if the validator exits successfully.
Follow the documentation on the Forseti Security website to deploy Forseti. As part of the Terraform configuration, you will need to enable Config Validator and choose how to provide policies to Forseti Server.
To enable Config Validator in the Forseti Terraform configuration, set the
config_validator_enabled variable to true.
The recommended practice is to store the Policy Library in a VCS such as GitHub or other git repository. This supports the idea of policy as code and requires work to setup the repository and connect it with Forseti. Once the repository is setup, then Forseti will automatically sync policy updates to the Forseti Server to be used by future scans.
The default behavior of Forseti is to sync the Policy Library from the Forseti Server GCS bucket. This requires little setup, but involves manual work to create the folder and copy the policies to GCS.
As part of the Terraform configuration, you will need to include a few additional variables to enable the git-sync feature. Here are some details about these options which can be supplied in your main.tf:
policy_library_sync_enabled: Set totrueto enable git-syncpolicy_library_repository_url: Provide the URL for your Policy Library repository; git protocol is recommended. Example:git@github.com:forseti-security/policy-library- (OPTIONAL)
policy_library_sync_ssh_known_hosts: Provide the known host keys for the git repository. This can be obtained by runningssh-keyscan ${YOUR_GIT_HOST}.
You should also setup an outputs.tf configuration file for Terraform to obtain the auto-generated public SSH key.
output "forseti-server-git-public-key-openssh" {
description = "The public OpenSSH key generated to allow the Forseti Server to clone the policy library repository."
value = module.server.forseti-server-git-public-key-openssh
}
IMPORTANT: After applying the Terraform configuration, you will need to add the generated SSH key to the git user account. The SSH key will be provided as an output from Terraform. If the Policy Library repository is hosted on GitHub, you can follow these steps to add the SSH key to your account.
To obtain the generated SSH key from Terraform run this command:
terraform output forseti-server-git-public-key-openssh
You can view any logs related to this process from Stackdriver Logging by
searching for git-sync.
To sync policies from GCS to the Forseti server, you will need to create the GCS folder.
Open the Forseti project in the Google Cloud Console
and go to Storage in the menu. The Forseti Server bucket will be named
forseti-server-{SUFFIX} where {SUFFIX} is a random 8 character suffix setup
at the time Forseti is deployed. Create a folder with the name policy-library
inside the Forseti Server bucket and make note of the suffix.
Assuming you have a local copy of your policy library repository, you can follow
these steps to copy them to GCS (replace {SUFFIX} with the suffix noted above):
export FORSETI_BUCKET=forseti-server-{SUFFIX}
export POLICY_LIBRARY_PATH=path/to/local/policy-library
gsutil -m rsync -d -r ${POLICY_LIBRARY_PATH}/policies gs://${FORSETI_BUCKET}/policy-library/policies
gsutil -m rsync -d -r ${POLICY_LIBRARY_PATH}/lib gs://${FORSETI_BUCKET}/policy-library/lib
Example result: 
After this is done, Forseti will pick up the new policy library content in the next scanner run.
Forseti has a plugin with Cloud Security Command Center (CSCC) which allows you to receive PubSubs with CSCC. By subscribing to the PubSub feed, you have control of remediating manually or programmatically with Cloud Functions.
To connect to CSCC, you need the following roles:
- Organization Admin
- Security Center Admin
- Service Account Admin
Follow step 1-4 listed here to set CSCC up for Forseti.
Once you have CSCC set up, you can navigate to the CSCC settings page from the
Google Cloud Platform (GCP) UI. For example:
In main.tf, under module "forseti", include cscc_source_id and cscc_violations_enabled. Set cscc_source_id to the source ID generated by CSCC for Forseti, and _cscc_violations_enabled** _to true**.
module "forseti" {
…..
cscc_source_id = "YOUR_CSCC_SOURCE_ID_FOR_FORSETI"
cscc_violations_enabled = true
}
Run terraform plan command to see the change and terraform apply command to apply the change.
In this section, you will apply a constraint that enforces IAM policy member domain restriction using Cloud Shell.
First click on this link to open a new Cloud Shell session. The Cloud Shell session has Terraform pre-installed and the Policy Library repository cloned. Once you have the session open, the next step is to copy over the sample IAM domain restriction constraint:
cp policy-library/samples/iam_service_accounts_only.yaml policy-library/policies/constraints
Let's take a look at this constraint:
apiVersion: constraints.gatekeeper.sh/v1alpha1
kind: GCPIAMAllowedPolicyMemberDomainsConstraintV1
metadata:
name: service_accounts_only
spec:
severity: high
match:
target: ["organization/*"]
parameters:
domains:
- gserviceaccount.com
It specifies that only members from gserviceaccount.com domain can be present in
an IAM policy. To verify that it works, let's attempt to create a project.
Create the following Terraform main.tf file:
provider "google" {
version = "~> 1.20"
project = "your-terraform-provider-project"
}
resource "random_id" "proj" {
byte_length = 8
}
resource "google_project" "sample_project" {
project_id = "validator-${random_id.proj.hex}"
name = "config validator test project"
}
resource "google_project_iam_binding" "sample_iam_binding" {
project = "${google_project.sample_project.project_id}"
role = "roles/owner"
members = [
"user:your-email@your-domain"
]
}
Make sure to specify your Terraform provider project and email address. Then initialize Terraform and generate a Terraform plan:
terraform init
terraform plan -out=test.tfplan
Since your email address is in the IAM policy binding, the plan should result in a violation. Let's try this out:
gsutil cp gs://terraform-validator/releases/2019-03-28/terraform-validator-linux-amd64 .
chmod 755 terraform-validator-linux-amd64
./terraform-validator-linux-amd64 validate test.tfplan --policy-path=policy-library
The Terraform validator should return a violation. As a test, you can relax the
constraint to make the violation go away. Edit the
policy-library/policies/constraints/iam_service_accounts_only.yaml file and
append your email domain to the domains whitelist:
apiVersion: constraints.gatekeeper.sh/v1alpha1
kind: GCPIAMAllowedPolicyMemberDomainsConstraintV1
metadata:
name: service_accounts_only
spec:
severity: high
match:
target: ["organization/*"]
parameters:
domains:
- gserviceaccount.com
- your-domain-here
Then run Terraform plan and validate the output again:
terraform plan -out=test.tfplan
./terraform-validator-linux-amd64 validate test.tfplan --policy-path=policy-library
The command above should result in no violations found.
Questions or comments? Please contact validator-support@google.com.