DataNodes Down

Ambari.SCOM.UnitMonitor.HdfsDeadDataNodes (UnitMonitor)

Gives warning/critical alert if percentage of dead HDFS data nodes in cluster is more than lower/upper threshold.

Knowledge Base article:

Summary

Gives warning/critical alert if percentage of dead HDFS data nodes in cluster is more than lower/upper threshold.

Causes

TBD

Resolutions

TBD

Element properties:

TargetAmbari.SCOM.ClusterService.Hdfs
Parent MonitorSystem.Health.AvailabilityState
CategoryAvailabilityHealth
EnabledTrue
Alert GenerateTrue
Alert SeverityMatchMonitorHealth
Alert PriorityNormal
Alert Auto ResolveTrue
Monitor TypeAmbari.SCOM.UnitMonitorType.HdfsServiceThreeStateThreshold
RemotableTrue
AccessibilityPublic
Alert Message
A significant number of DataNodes are down in the cluster.
There are {1}\% down DataNodes in cluster "{0}".
RunAsDefault

Source Code:

<UnitMonitor ID="Ambari.SCOM.UnitMonitor.HdfsDeadDataNodes" TypeID="Ambari.SCOM.UnitMonitorType.HdfsServiceThreeStateThreshold" Target="Ambari.SCOM.ClusterService.Hdfs" ParentMonitorID="Health!System.Health.AvailabilityState" Remotable="true" Priority="Normal" Accessibility="Public" Enabled="true" ConfirmDelivery="true">
<Category>AvailabilityHealth</Category>
<AlertSettings AlertMessage="Ambari.SCOM.UnitMonitor.HdfsDeadDataNodes.AlertMessage">
<AlertOnState>Warning</AlertOnState>
<AutoResolve>true</AutoResolve>
<AlertPriority>Normal</AlertPriority>
<AlertSeverity>MatchMonitorHealth</AlertSeverity>
<AlertParameters>
<AlertParameter1>$Target/Host/Property[Type="Ambari.SCOM.ClusterService.Private"]/ClusterName$</AlertParameter1>
<AlertParameter2>$Data/Context/Property[@Name='deadnodes_percent']$</AlertParameter2>
</AlertParameters>
</AlertSettings>
<OperationalStates>
<OperationalState ID="Healthy" MonitorTypeStateID="Healthy" HealthState="Success"/>
<OperationalState ID="Warning" MonitorTypeStateID="Warning" HealthState="Warning"/>
<OperationalState ID="Critical" MonitorTypeStateID="Critical" HealthState="Error"/>
</OperationalStates>
<Configuration>
<IntervalSeconds>900</IntervalSeconds>
<TimeoutSeconds>300</TimeoutSeconds>
<PropertyName>deadnodes_percent</PropertyName>
<TheGreaterTheBetter>false</TheGreaterTheBetter>
<WarningThreshold>0.01</WarningThreshold>
<CriticalThreshold>20</CriticalThreshold>
</Configuration>
</UnitMonitor>