spark demos crash

[scottdraves]

when you start the spark session it crashes with:

2018-07-02 17:52:34:620 -0400 [SparkUI-61] WARN  Errors - The following warnings have been detected: WARNING: Unknown HK2 failure detected:
MultiException stack 1 of 2
java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.JsonMappingException.<init>(Ljava/io/Closeable;Ljava/lang/String;)V
        at com.fasterxml.jackson.module.scala.JacksonModule$class.setupModule(JacksonModule.scala:56)
        at com.fasterxml.jackson.module.scala.DefaultScalaModule.setupModule(DefaultScalaModule.scala:19)
        at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:718)
        at org.apache.spark.status.api.v1.JacksonMessageWriter.<init>(JacksonMessageWriter.scala:50)
...

[scottdraves]

aha twosigma/flint@9baab2b

[scottdraves]

tried changing loading of flint to:

%%classpath add mvn
com.github.twosigma flint master-b560b000bc-1
org.apache.spark spark-sql_2.11 2.2.1
org.apache.spark spark-mllib_2.11 2.2.1

but broken in a different way:

2018-07-02 23:01:05:747 -0400 [Thread-0] ERROR KernelSocketsZMQ - java.lang.AbstractMethodError: io.netty.util.concurrent.MultithreadEventExecutorGroup.newChild(Ljava/util/concurrent/Executor;[Ljava/lang/Object;)Lio/netty/util/concurrent/EventExecutor;

[scottdraves]

@lmitusinski figured out this works:

%%classpath add mvn
io.netty netty-all 4.1.25.Final
io.netty netty-buffer 4.1.25.Final
io.netty netty-common 4.1.25.Final
com.github.twosigma flint master-b560b000bc-1
org.apache.spark spark-sql_2.11 2.2.1
org.apache.spark spark-mllib_2.11 2.2.1

and this is related: netty/netty#7605

but now our main SparkUI.ipynb is failing like this:

018-07-03 13:46:49:555 -0400 [SparkUI-139] WARN  Errors - The following warnings have been detected: WARNING: Unknown HK2 failure detected:
MultiException stack 1 of 2
com.fasterxml.jackson.databind.JsonMappingException: Incompatible Jackson version: 2.7.2
        at com.fasterxml.jackson.module.scala.JacksonModule$class.setupModule(JacksonModule.scala:64)
        at com.fasterxml.jackson.module.scala.DefaultScalaModule.setupModule(DefaultScalaModule.scala:19)
        at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:722)
        at org.apache.spark.status.api.v1.JacksonMessageWriter.<init>(JacksonMessageWriter.scala:50)

[scottdraves]

http://spark.apache.org/releases/spark-release-2-1-3.html maybe related somehow???

[scottdraves]

6db4f63
243e1d1