Cloud Foundry Shared Redis Release

This repository contains a BOSH release for a Cloud Foundry Shared Redis service broker. It supports a shared-vm plan.

Note: Breaking change > version 434.3.6 - the redis.limits.maxclients property is now redis.maxclients

git clone https://github.com/pivotal-cf/shared-redis-release ~/workspace/shared-redis-release
cd ~/workspace/shared-redis-release
git submodule update --init --recursive

Deployment dependencies

1. BOSH CLI v2+ (you may use the old BOSH CLI but instructions will use the new one)
2. direnv (or set environment variables yourself)
3. a bosh director
4. a cloud foundry deployment

Deployment

Run the following steps:

1. fill out the following environment variables of the .envrc.template file and save as .envrc or export them. All or almost all the variables are required for tests but these are the minimum required for deploy:
   • BOSH_ENVIRONMENT
   • BOSH_CA_CERT
   • BOSH_CLIENT
   • BOSH_CLIENT_SECRET
   • BOSH_DEPLOYMENT
2. if you're using the .envrc file

   direnv allow

3. upload dependent releases

   bosh upload-release http://bosh.io/d/github.com/cloudfoundry-incubator/cf-routing-release
   bosh upload-release http://bosh.io/d/github.com/cloudfoundry/syslog-release
   bosh upload-release http://bosh.io/d/github.com/cloudfoundry-incubator/bpm-release # required for routing 180+

Populate a vars file (using manifest/vars-lite.yml as a template), save it to secrets/vars.yml. You will need values from both your cloud-config and secrets from your cf-deployment.

To deploy:

bosh upload-stemcell https://s3.amazonaws.com/bosh-core-stemcells/warden/bosh-stemcell-97.3-warden-boshlite-ubuntu-xenial-go_agent.tgz
bosh create-release
bosh upload-release
bosh deploy --vars-file secrets/vars.yml manifest/deployment.yml

Network Configuration

The following ports and ranges are used in this service:

• broker vm, port 12350: access to the broker from the cloud controllers
• broker vm, ports 32768-61000: on the service broker from the Diego Cell and Diego Brain network(s). This is only required for the shared service plan
• dedicated node, port 6379: access to all dedicated nodes from the Diego Cell and Diego Brain network(s)

Testing

1. install gem requirements

   bundle install

2. run the tests

   bundle exec rspec spec
   

Related Documentation

• BOSH
• Service Broker API
• Redis

Known Issues

Possible Data Leak when disabling Static IPs

In the past cf-redis-release expected to be deployed with static IPs for dedicated nodes specified in the manifest. It is often more desired to deploy without static IPs leaving BOSH to manage IP allocation.

There is a risk of data leak when transitioning from static to dynamic IPs. Consider the following scenario:

The operator:

1. has deployed cf-redis-release with static IPs
2. now decides to use dynamic IP allocation, and removes the static IPs from the manifest
3. then DOES NOT remove the static IPs from cloud config
4. re-deploys cf-redis-release with the new manifest

In the previous scenario BOSH will dynamically allocate IPs to the dedicated instances. BOSH will not try to re-use the previous IPs since those are still restricted in the cloud config. Since the IPs have changed, application bindings will break and the state in the broker will be out of sync with the new deployment. It is possible that previously allocated instances containing application data are erroneously re-allocated to another unrelated application, causing data to be leaked.

In order to avoid this scenario, the operator must remove the reserved static IPs in the cloud config at the same time as they are remove from the manifest. This will allow BOSH to keep the same IP addresses for the existing nodes.

To safely transition from static to dynamic IPs:

1. look up the static IPs that were specified in the manifest when deploying your dedicated nodes
2. ensure these IPs are no longer included in the static range of the network in your cloud config
3. remove the static IPs from the manifest
4. deploy using the manifest without static IPs

Errands

The Cf-Redis Service Broker offers the following BOSH errands:

broker-registrar

Communicates to the CloudFoundry Cloud Controller which maintains the database for the CF Marketplace. This enables the service plans on the CF Marketplace so that App Developers can create and delete service instances of those plans.

broker-deregistrar

Communicates with the CF Cloud Controller to remove the cf-redis broker and service plans from the CF Marketplace as well as delete the broker deployment from BOSH. Note: If any service instances exist, the errand will fail. This is to prevent orphan deployments which the CF Cloud Controller will lose record of but will continue to live as a BOSH deployment which would continue to incur costs. If you wish to remove the service broker, perform a cf delete-service SERVICE_INSTANCE and remove all service instances associated with the broker and run the errand after all service instances have been removed.

smoke-tests

Runs smoke tests which tests the lifecycle and functionality of the both the dedicated-vm and shared-vm services. See the Redis documentation for more information.

The CI pipeline for this Repo lives here: https://runway-ci.eng.vmware.com/teams/tanzu-redis/pipelines/shared-redis