Heron issue #2919

Scripts and code to reproduce issue #2919 of Heron.

Requirements

• kubectl
• Minikube
• Helm client (the script install the server)

The script also downloads Pants.

Instructions

Launch all:

git clone https://github.com/cristobalcl/heron-issue-2919.git
cd heron-issue-2919
./run.sh

Follow Heron server logs:

kubectl logs --namespace heron -f `kubectl get --namespace heron pods --context=minikube --selector=app=heron-tools --output=jsonpath='{.items..metadata.name}'` heron-apiserver

Try to submit the topology again (this is doing in the run.sh already):

cd word_count
./pants binary topologies:WordCountTopology
heron submit heron ./dist/WordCountTopology.pex  --deploy-deactivated --verbose \
    - word-count-topology

Get Kubernetes dashboard URL:

nikube dashboard --url

Get Heron dashboard URL:

minikube service -n heron --url heron-web

Comments

If you open word_count/topologies/BUILD you will see a lot of not used dependencies. Thore are used to build a big PEX... With small PEX the submit works but then a new message error appears:

[…] [ERROR]: Failed to get physical plan for topology 'word-count-topology'

So you can comment all the dependencies except :word_count and 3rdparty:heronpy and try to submit again.