get host address from driver socket

[flybywind]

try to fix the problem decribed in issue 397:
#397

[mmlspark-bot]

Canceled! — The build has canceled. (1e795774)

[msftclas]

All CLA requirements met.

[imatiach-msft]

LGTM, let me try this out once we get a green build

[mmlspark-bot]

Pass! — The build has succeeded. (3127a57d)

MMLSpark 0.14.dev10+5.g3127a57d

This is a build for Github PR #399, changes:

• [3127a57d] wentongxin clear all usage for executor id-address map
• [af6d2dc0] wentongxin Merge branch 'fix-executorid-change' of github.com:flybywind/mmlspark into fix-executorid-change
• [73f8853a] wentongxin Merge remote-tracking branch 'origin/master' into fix-executorid-change
• [0197a688] flybywind Merge branch 'master' into fix-executorid-change
• [1e795774] wentongxin get host address from driver socket

---

• Source: flybywind/mmlspark,
  fix-executorid-change at revision 3127a57
  (by wentongxin wentongxin@xiaomi.com).

• Build: MMLSpark, 1673043
  (built by elbarzil-vm on elbarzil-vm, 2018-10-17 17:53)

• Info:
  0.14.dev10+5.g3127a57d: flybywind/mmlspark/fix-executorid-change@3127a57d; MMLSpark#1673043

• Queued by:
  Ilya Matiach for Ilya Matiach

• Maven package uploaded, use --packages com.microsoft.ml.spark:mmlspark_2.11:0.14.dev10+5.g3127a57d and --repositories https://mmlspark.azureedge.net/maven.

• PIP package uploaded.

• R package uploaded.

• HDInsight: Copy the link to this Script Action to setup this build on a cluster.

• ARM Template: Use this ARM Template to setup a cluster with a gpu (in the portal).

  • HDI Sub-Template: Use the HDI sub-template for just the hdi deployment (in the portal).

  • GPU VM Sub-Template: Use the GPU sub-template for just the gpu vm deployment (in the portal).

  • Convenient Deployment Script: Download this bash script or this powershell script, create a paramers file based on this template, and run as

    ./deploy-arm.sh ... -p <your-parameters>
    

• Documentation uploaded.

[flybywind]

thanks, and I have tested it on a large dataset in our spark, results seemed well

[imatiach-msft]

LGTM!

[mmlspark-bot]

Pass! — The build has succeeded. (db5c51c6)

MMLSpark 0.14.dev10+6.gdb5c51c6

This is a build for Github PR #399, changes:

• [db5c51c6] flybywind@foxmail.com revert changes in build.sh
• [3127a57d] wentongxin clear all usage for executor id-address map
• [af6d2dc0] wentongxin Merge branch 'fix-executorid-change' of github.com:flybywind/mmlspark into fix-executorid-change
• [73f8853a] wentongxin Merge remote-tracking branch 'origin/master' into fix-executorid-change
• [0197a688] flybywind Merge branch 'master' into fix-executorid-change
• [1e795774] wentongxin get host address from driver socket

---

• Source: flybywind/mmlspark,
  fix-executorid-change at revision db5c51c
  (by flybywind@foxmail.com flybywind@foxmail.com).

• Build: MMLSpark, 1696655
  (built by elbarzil-vm on elbarzil-vm, 2018-10-22 15:06)

• Info:
  0.14.dev10+6.gdb5c51c6: flybywind/mmlspark/fix-executorid-change@db5c51c6; MMLSpark#1696655

• Queued by:
  Ilya Matiach for Ilya Matiach

• Maven package uploaded, use --packages com.microsoft.ml.spark:mmlspark_2.11:0.14.dev10+6.gdb5c51c6 and --repositories https://mmlspark.azureedge.net/maven.

• PIP package uploaded.

• R package uploaded.

• HDInsight: Copy the link to this Script Action to setup this build on a cluster.

• ARM Template: Use this ARM Template to setup a cluster with a gpu (in the portal).

  • HDI Sub-Template: Use the HDI sub-template for just the hdi deployment (in the portal).

  • GPU VM Sub-Template: Use the GPU sub-template for just the gpu vm deployment (in the portal).

  • Convenient Deployment Script: Download this bash script or this powershell script, create a paramers file based on this template, and run as

    ./deploy-arm.sh ... -p <your-parameters>
    

• Documentation uploaded.

[imatiach-msft]

I verified this PR on a spark cluster with the build, @mhamilton723 could you please approve the PR? Thanks!