Collect TaskTracker Shuffle Success Outputs

Ambari.SCOM.PerformanceRule.TaskTrackerShuffleSuccessOutputs (Rule)

This rule collects number of successful outputs for shuffle running on Hadoop TaskTracker.

Knowledge Base article:

Summary

Collects number of successful outputs for shuffle running on Hadoop TaskTracker.

Element properties:

Target	Ambari.SCOM.HostComponent.TaskTracker
Category	PerformanceCollection
Enabled	True
Alert Generate	False
Remotable	True

Member Modules:

ID	Module Type	TypeId	RunAs
DS	DataSource	Ambari.SCOM.Module.HostComponentMetricsPerformanceDataSource	Default
WriteToDB	WriteAction	Microsoft.SystemCenter.CollectPerformanceData	Default
WriteToDW	WriteAction	Microsoft.SystemCenter.DataWarehouse.PublishPerformanceData	Default

Source Code:

<Rule ID="Ambari.SCOM.PerformanceRule.TaskTrackerShuffleSuccessOutputs" Target="Ambari.SCOM.HostComponent.TaskTracker" Enabled="true" ConfirmDelivery="false">

  <Category>PerformanceCollection</Category>

  <DataSources>

    <DataSource ID="DS" TypeID="Ambari.SCOM.Module.HostComponentMetricsPerformanceDataSource">

      <IntervalSeconds>900</IntervalSeconds>

      <TimeoutSeconds>300</TimeoutSeconds>

      <PropertyName>mapred.shuffleoutput.shuffle_success_outputs</PropertyName>

      <CounterName>Shuffle Success Outputs</CounterName>

    </DataSource>

  </DataSources>

  <WriteActions>

    <WriteAction ID="WriteToDB" TypeID="SC!Microsoft.SystemCenter.CollectPerformanceData"/>

    <WriteAction ID="WriteToDW" TypeID="SCDW!Microsoft.SystemCenter.DataWarehouse.PublishPerformanceData"/>

  </WriteActions>

</Rule>