Skip to content

Commit

Permalink
Merge pull request #3 from shahrukhkhan489/tuning_fix
Browse files Browse the repository at this point in the history
Updating FetcherConf to use MapReduceFSFetcherHadoop for performance
  • Loading branch information
shahrukhkhan489 authored Oct 30, 2017
2 parents 1b1f075 + f421850 commit dd36b55
Showing 1 changed file with 6 additions and 2 deletions.
8 changes: 6 additions & 2 deletions app-conf/FetcherConf.xml
Original file line number Diff line number Diff line change
Expand Up @@ -29,13 +29,15 @@
</fetcher>
-->
<fetchers>
<!--
<fetcher>
<applicationtype>mapreduce</applicationtype>
<classname>com.linkedin.drelephant.mapreduce.fetchers.MapReduceFetcherHadoop2</classname>
<params>
<sampling_enabled>false</sampling_enabled>
</params>
</fetcher>
-->
<!--
This is an experimental replacement for the MapReduceFetcherHadoop2 that attempts to burn
through queues of jobs faster by pulling data directly from HDFS rather than going through
Expand All @@ -49,17 +51,19 @@
To work properly, this fetcher should use the same timezone with the job history server.
If not set, the local timezone will be used.
-->
<!--

<fetcher>
<applicationtype>mapreduce</applicationtype>
<classname>com.linkedin.drelephant.mapreduce.fetchers.MapReduceFSFetcherHadoop2</classname>
<params>
<sampling_enabled>false</sampling_enabled>
<!--
<history_log_size_limit_in_mb>500</history_log_size_limit_in_mb>
<history_server_time_zone>PST</history_server_time_zone>
-->
</params>
</fetcher>
-->


<!--
FSFetcher for Spark. Loads the eventlog from HDFS and replays to get the metrics and application properties
Expand Down

0 comments on commit dd36b55

Please sign in to comment.