Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix exlude error #28

Closed
wants to merge 3 commits into from
Closed

fix exlude error #28

wants to merge 3 commits into from

Conversation

cjuexuan
Copy link

fix exclude error ,if use old ,we will exclude hadoop by spark ,and cause classnotfind error

@cjuexuan cjuexuan closed this Apr 27, 2016
@cjuexuan cjuexuan reopened this Apr 27, 2016
@cjuexuan cjuexuan closed this Apr 27, 2016
change hadoop version : 2.3.0,spark version 1.4.0
@cjuexuan cjuexuan reopened this Apr 27, 2016
@cjuexuan
Copy link
Author

I'm so sorry about this,because I can't find a hadoop lib in lib dir ,and the I run dependencyTree > tree and in vi I find the hadoop lib in reload,so I do this ,but what can we do to load the hadoop lib in lib dir

@cjuexuan cjuexuan closed this Apr 27, 2016
@cjuexuan
Copy link
Author

oh ,I see , we should delete Test on " "org.apache.hadoop" % "hadoop-common" % hadoopVersion "

@akshayrai
Copy link
Contributor

@cjuexuan, I am not sure how I missed these messages.

Dr. Elephant gets the hadoop jars from the hadoop classpath. It adds them to the classpath before starting. You can take a look in the compile.sh script(search for hadoop classpath, line 104). We shouldn't include the hadoop jars in the lib as they can conflict with the hadoop jars from the environment where you are running.

@cjuexuan
Copy link
Author

@akshayrai thx

shkhrgpt added a commit to shkhrgpt/dr-elephant that referenced this pull request Feb 28, 2017
* Fix linkedin#162 with the right calculation for resourceswasted and  add missing workflow links (linkedin#207)

* Fix Exception thrown when JAVA_EXTRA_OPTIONS is not present (linkedin#210)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants