Kafka on EC2

Ansible scripts for deploying Kafka (v0.9.1 with Zookeeper 3.4.6) on EC2. These scripts were developed based on various resources from Internet. Below is the main reference:

Ansible Playbook - Setup Kafka Cluster

How To Run

Prerequisites

Ansible
boto - required for Ansible EC2 module
Setup boto configuration based on http://boto.readthedocs.org/en/latest/boto_config_tut.html
Access to EC2 Key Pair

Steps

Edit configuration file group_vars/all based on your reqiurements and environment.
Execute ansible-playbook --private-key=<AWS_key_file> -u ubuntu kafka.yml

Notes

In one of my Macs I got the error described in ansible/ansible#5734. If you are getting the same error please use the inventory file provided (ansible-playbook --private-key=<AWS_key_file> -u ubuntu -i inventory kafka.yml).