Skip to content

Implementing graph processing algorithms in a distributed environment using Docker, Neo4j, Kafka, and Kubernetes.

License

Notifications You must be signed in to change notification settings

Shikhar97/Kafka-Neo4j

Repository files navigation

sgupt330-project-2-phase2

  1. To install:

    1. I used brew install minikube to install.
    2. Also, I used minikube config set driver docker to set docker as my default driver
  2. To deploy:

    1. I configured the service and deployment sections in the yaml file
    2. Used minikube start -p CSE511-project2-phase2 to start the cluster
    3. Used kubectl apply -f ./kafka-setup.yaml and kubectl apply -f ./zookeeper-setup.yaml to deploy the pods.
  3. I verified my deployment in two ways:

Sending data from local host to Kafka using the following command:

kubectl port-forward <kafka-pod-name> 29092
echo "hello Kafka" | kcat -P -b localhost:29092 -t test
kcat -C -b localhost:29092 -t test

Checking connectivity between zookeeper and kafka and listing the kafka broker id and topics.

kubectl exec -it <kafka-pod-name> -- /bin/bash
zookeeper-shell.sh zookeeper-service:2181
ls /brokers/ids
ls /brokers/topics

About

Implementing graph processing algorithms in a distributed environment using Docker, Neo4j, Kafka, and Kubernetes.

Topics

Resources

License

Stars

Watchers

Forks