Docker Compose

Compose is a tool for defining and running multi-container Docker applications. With Compose, you use a Compose file to configure your application's services. Then, using a single command, you create and start all the services from your configuration. To learn more about all the features of Compose see the list of features.

Compose is great for development, testing, and staging environments, as well as CI workflows. You can learn more about each case in Common Use Cases.

Using Compose is basically a three-step process.

1. Define your app's environment with a Dockerfile so it can be reproduced anywhere.
2. Define the services that make up your app in docker-compose.yml so they can be run together in an isolated environment.
3. Lastly, run docker-compose up and Compose will start and run your entire app.

A docker-compose.yml looks like this:

version: '2'

services:
  web:
    build: .
    ports:
     - "5000:5000"
    volumes:
     - .:/code
  redis:
    image: redis

For more information about the Compose file, see the Compose file reference.

Compose has commands for managing the whole lifecycle of your application:

• Start, stop and rebuild services
• View the status of running services
• Stream the log output of running services
• Run a one-off command on a service

Installation and documentation

• Full documentation is available on Docker's website.
• Code repository for Compose is on GitHub.

Install Compose on Linux systems

On Linux, you can download the Docker Compose binary from the Compose repository release page on GitHub. Follow the instructions from the link, which involve running the curl command in your terminal to download the binaries. These step by step instructions are also included below

1. Run this command to download the latest version of Docker Compose:

$ sudo curl -L https://github.com/docker/compose/releases/download/1.18.0/docker-compose-`uname -s`-`uname -m` -o /usr/local/bin/docker-compose

2. Apply executable permissions to the binary:

$ sudo chmod +x /usr/local/bin/docker-compose

3. Optionally, install command completion for the bash and zsh shell.
4. Test the installation.

$ docker-compose --version
docker-compose version 1.18.0, build fdd22a9

BigDataGrapes docker-compose.yml is the following:

version: '1.0'
 services:
  elasticsearch:
image: bigdatagrapes/elasticsearch
container_name: elasticsearch
environment:
  - "192.168.1.77"
ports:
  - 9200:9200
  - 9300:9300  
kibana:
image: bigdatagrapes/kibana
container_name: kibana
environment:
  - "192.168.1.77"
ports:
  - 5601:5601
hbase:
image: bigdatagrapes/hbase
container_name: hbase
environment:
  - "192.168.1.77"
ports:
  - 16000:16000
  - 16010:16010
   flink:
image: bigdatagrapes/flink
container_name: flink
environment:
  - "192.168.1.77"
ports:
  - 6123:6123
  - 8089:8089
spark-master:
image: bigdatagrapes/spark-master
container_name: spark-master
environment:
  - "192.168.1.77"
ports:
  - 8080:8080
  - 6066:6066
  - 7077:7077
spark-worker:
image: bigdatagrapes/spark-worker
container_name: spark-worker
environment:
  - "192.168.1.77"
ports:
  - 8081:8081
mongo:
image: bigdatagrapes/mongo
container_name: mongo
environment:
  - "192.168.1.77"
ports:
  - 27017:27017
kafka:
image: bigdatagrapes/kafka
container_name: kafka
environment:
  - "192.168.1.77"
ports:
  - 9092:9092	  
  - 2181:2181	  
flume:
image: bigdatagrapes/flume
container_name: flume
environment:
  - "192.168.1.77"
hadoop:
image: bigdatagrapes/kibana
container_name: kibana
environment:
  - "192.168.1.77"
ports:
  - 2122:2122
  - 8030:8030	
  - 8040:8040	
  - 8042:8042	
  - 8088:8088	
  - 19888:19888	
  - 49707:49707	
  - 50010:50010	
  - 50020:50020	
  - 50070:50070	
  - 50075:50075	
  - 50090:50090	
phpmyadmin:
image: bigdatagrapes/phpmyadmin
container_name: phpmyadmin
environment:
  - "192.168.1.77"
ports:
  - 9000:9000
mysql:
image: bigdatagrapes/mysql
container_name: mysql
environment:
  - "192.168.1.77"
ports:
  - 3306:3306
  - 33060:33060
tomcat:
image: bigdatagrapes/tomcat
container_name: tomcat
environment:
  - "192.168.1.77"
ports:
  - 8888:8888
logstash:
image: bigdatagrapes/logstash
container_name: logstash
environment:
  - "192.168.1.77"
graphdb:
image: bigdatagrapes/graphdb
container_name: graphdb
environment:
  - "192.168.1.77"	  
ports:
  - 7200:7200

List of Docker Images

Component	Location
Graphdb	bigdatagrapes/graphdb
Sparkling-water	bigdatagrapes/sparklingwater
Virtuoso	bigdatagrapes/virtuoso
Neo4j	bigdatagrapes/neo4j
Hbase	bigdatagrapes/hbase
Kafka	bigdatagrapes/kafka
Flink	bigdatagrapes/flinl
Flume	bigdatagrapes/flume
Kibana	bigdatagrapes/kibana
Elasticsearch	bigdatagrapes/elasticsearch
Spark-master	bigdatagrapes/spark-master
Spark-worker	bigdatagrapes/spark-worker
Hadoop	bigdatagrapes/hadoop
PhpMyAdmin	bigdatagrapes/phpmyadmin
Mysql	bigdatagrapes/mysql
Tomcat	bigdatagrapes/tomcat
Cassandra	bigdatagrapes/cassandra