I forget mention the version I used. <br>I used SLES11-SP1-HAE Beta5<br>Pacemaker 1.0.7<br>Corosync 1.2.0<br>Cluster Glue 1.0.3<br><br><br><div class="gmail_quote">2010/5/14 Javen Wu <span dir="ltr">&lt;<a href="mailto:wu.javen@gmail.com">wu.javen@gmail.com</a>&gt;</span><br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">Hi Folks,<br><br>I setup a three nodes cluster with SBD STONITH configured.<br>After I manually isolate one node by running &quot;ifconfig eth1 down&quot; on the node. The node is fenced as expected.<br>
But after reboot, even the network is recovered, the node is killed again once I start openais&amp;pacemaker.<br>
I saw the state of the node become from OFFLINE to ONLINE from `crm_mon -n` before being killed. And I saw SBD slot from reset-&gt;clear-&gt;reset.<br><br>I attached the syslog and corosync log.<br>And my CIB configuration is very simple.<br>

<br>Could you help me check what&#39;s the problem? In my mind, it&#39;s not expected behaviour.<br><br>===%&lt;====CIB information=====================<br><br>&lt;cib validate-with=&quot;pacemaker-1.0&quot; crm_feature_set=&quot;3.0.1&quot; have-quorum=&quot;1&quot; admin_epoch=&quot;0&quot; epoch=&quot;349&quot; num_updates=&quot;99&quot; cib-last-written=&quot;Fri May 14 14:50:21 2010&quot; dc-uuid=&quot;vm209&quot;&gt;<br>

  &lt;configuration&gt;<br>    &lt;crm_config&gt;<br>      &lt;cluster_property_set id=&quot;cib-bootstrap-options&quot;&gt;<br>        &lt;nvpair id=&quot;cib-bootstrap-options-dc-version&quot; name=&quot;dc-version&quot; value=&quot;1.1.1-530add2a3721a0ecccb24660a97dbfdaa3e68f51&quot;/&gt;<br>

        &lt;nvpair id=&quot;cib-bootstrap-options-cluster-infrastructure&quot; name=&quot;cluster-infrastructure&quot; value=&quot;openais&quot;/&gt;<br>        &lt;nvpair id=&quot;cib-bootstrap-options-expected-quorum-votes&quot; name=&quot;expected-quorum-votes&quot; value=&quot;3&quot;/&gt;<br>

      &lt;/cluster_property_set&gt;<br>    &lt;/crm_config&gt;<br>    &lt;nodes&gt;<br>      &lt;node id=&quot;vm208&quot; uname=&quot;vm208&quot; type=&quot;normal&quot;/&gt;<br>      &lt;node id=&quot;vm209&quot; uname=&quot;vm209&quot; type=&quot;normal&quot;/&gt;<br>

      &lt;node id=&quot;vm210&quot; uname=&quot;vm210&quot; type=&quot;normal&quot;/&gt;<br>    &lt;/nodes&gt;<br>    &lt;resources&gt;<br>      &lt;clone id=&quot;Fencing&quot;&gt;<br>        &lt;primitive class=&quot;stonith&quot; id=&quot;sbd-fencing&quot; type=&quot;external/sbd&quot;&gt;<br>

          &lt;instance_attributes id=&quot;sbd-fencing-instance_attributes&quot;&gt;<br>            &lt;nvpair id=&quot;sbd-fencing-instance_attributes-sbd_device&quot; name=&quot;sbd_device&quot; value=&quot;/dev/sdc&quot;/&gt;<br>

          &lt;/instance_attributes&gt;<br>          &lt;operations&gt;<br>            &lt;op id=&quot;sbd-fencing-monitor-20s&quot; interval=&quot;20s&quot; name=&quot;monitor&quot;/&gt;<br>          &lt;/operations&gt;<br>

        &lt;/primitive&gt;<br>      &lt;/clone&gt;<br>    &lt;/resources&gt;<br>    &lt;constraints/&gt;<br>    &lt;rsc_defaults/&gt;<br>    &lt;op_defaults/&gt;<br>  &lt;/configuration&gt;<br>  &lt;status&gt;<br>    &lt;node_state id=&quot;vm209&quot; uname=&quot;vm209&quot; ha=&quot;active&quot; in_ccm=&quot;true&quot; crmd=&quot;online&quot; join=&quot;member&quot; expected=&quot;member&quot; crm-debug-origin=&quot;post_cache_update&quot; shutdown=&quot;0&quot;&gt;<br>

      &lt;transient_attributes id=&quot;vm209&quot;&gt;<br>        &lt;instance_attributes id=&quot;status-vm209&quot;&gt;<br>          &lt;nvpair id=&quot;status-vm209-probe_complete&quot; name=&quot;probe_complete&quot; value=&quot;true&quot;/&gt;<br>

        &lt;/instance_attributes&gt;<br>      &lt;/transient_attributes&gt;<br>      &lt;lrm id=&quot;vm209&quot;&gt;<br>        &lt;lrm_resources&gt;<br>          &lt;lrm_resource id=&quot;sbd-fencing:0&quot; type=&quot;external/sbd&quot; class=&quot;stonith&quot;&gt;<br>

            &lt;lrm_rsc_op id=&quot;sbd-fencing:0_monitor_0&quot; operation=&quot;monitor&quot; crm-debug-origin=&quot;build_active_RAs&quot; crm_feature_set=&quot;3.0.1&quot; transition-key=&quot;4:1:7:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; transition-magic=&quot;0:7;4:1:7:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; call-id=&quot;2&quot; rc-code=&quot;7&quot; op-status=&quot;0&quot; interval=&quot;0&quot; last-run=&quot;1273820137&quot; last-rc-change=&quot;1273820137&quot; exec-time=&quot;60&quot; queue-time=&quot;0&quot; op-digest=&quot;4c3fd39434577fbb6540606d808ed050&quot;/&gt;<br>

            &lt;lrm_rsc_op id=&quot;sbd-fencing:0_start_0&quot; operation=&quot;start&quot; crm-debug-origin=&quot;build_active_RAs&quot; crm_feature_set=&quot;3.0.1&quot; transition-key=&quot;5:1:0:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; transition-magic=&quot;0:0;5:1:0:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; call-id=&quot;3&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;0&quot; last-run=&quot;1273820137&quot; last-rc-change=&quot;1273820137&quot; exec-time=&quot;10&quot; queue-time=&quot;0&quot; op-digest=&quot;4c3fd39434577fbb6540606d808ed050&quot;/&gt;<br>

            &lt;lrm_rsc_op id=&quot;sbd-fencing:0_monitor_20000&quot; operation=&quot;monitor&quot; crm-debug-origin=&quot;build_active_RAs&quot; crm_feature_set=&quot;3.0.1&quot; transition-key=&quot;6:2:0:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; transition-magic=&quot;0:0;6:2:0:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; call-id=&quot;4&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;20000&quot; last-run=&quot;1273822956&quot; last-rc-change=&quot;1273820137&quot; exec-time=&quot;1170&quot; queue-time=&quot;0&quot; op-digest=&quot;4029bbaef749649e82d602afb46dd872&quot;/&gt;<br>

          &lt;/lrm_resource&gt;<br>        &lt;/lrm_resources&gt;<br>      &lt;/lrm&gt;<br>    &lt;/node_state&gt;<br>    &lt;node_state id=&quot;vm208&quot; uname=&quot;vm208&quot; ha=&quot;dead&quot; in_ccm=&quot;false&quot; crmd=&quot;offline&quot; crm-debug-origin=&quot;send_stonith_update&quot; join=&quot;down&quot; expected=&quot;down&quot; shutdown=&quot;0&quot;/&gt;<br>

    &lt;node_state id=&quot;vm210&quot; uname=&quot;vm210&quot; ha=&quot;active&quot; in_ccm=&quot;true&quot; crmd=&quot;online&quot; crm-debug-origin=&quot;post_cache_update&quot; join=&quot;member&quot; expected=&quot;member&quot; shutdown=&quot;0&quot;&gt;<br>

      &lt;transient_attributes id=&quot;vm210&quot;&gt;<br>        &lt;instance_attributes id=&quot;status-vm210&quot;&gt;<br>          &lt;nvpair id=&quot;status-vm210-probe_complete&quot; name=&quot;probe_complete&quot; value=&quot;true&quot;/&gt;<br>

        &lt;/instance_attributes&gt;<br>      &lt;/transient_attributes&gt;<br>      &lt;lrm id=&quot;vm210&quot;&gt;<br>        &lt;lrm_resources&gt;<br>          &lt;lrm_resource id=&quot;sbd-fencing:2&quot; type=&quot;external/sbd&quot; class=&quot;stonith&quot;&gt;<br>

            &lt;lrm_rsc_op id=&quot;sbd-fencing:2_monitor_0&quot; operation=&quot;monitor&quot; crm-debug-origin=&quot;build_active_RAs&quot; crm_feature_set=&quot;3.0.1&quot; transition-key=&quot;8:5:7:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; transition-magic=&quot;0:7;8:5:7:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; call-id=&quot;2&quot; rc-code=&quot;7&quot; op-status=&quot;0&quot; interval=&quot;0&quot; last-run=&quot;1273820388&quot; last-rc-change=&quot;1273820388&quot; exec-time=&quot;20&quot; queue-time=&quot;0&quot; op-digest=&quot;4c3fd39434577fbb6540606d808ed050&quot;/&gt;<br>

            &lt;lrm_rsc_op id=&quot;sbd-fencing:2_start_0&quot; operation=&quot;start&quot; crm-debug-origin=&quot;build_active_RAs&quot; crm_feature_set=&quot;3.0.1&quot; transition-key=&quot;13:5:0:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; transition-magic=&quot;0:0;13:5:0:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; call-id=&quot;3&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;0&quot; last-run=&quot;1273820388&quot; last-rc-change=&quot;1273820388&quot; exec-time=&quot;10&quot; queue-time=&quot;0&quot; op-digest=&quot;4c3fd39434577fbb6540606d808ed050&quot;/&gt;<br>

            &lt;lrm_rsc_op id=&quot;sbd-fencing:2_monitor_20000&quot; operation=&quot;monitor&quot; crm-debug-origin=&quot;build_active_RAs&quot; crm_feature_set=&quot;3.0.1&quot; transition-key=&quot;14:5:0:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; transition-magic=&quot;0:0;14:5:0:f0adcb5c-10d1-4525-b094-b5ab1f776ee0&quot; call-id=&quot;4&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;20000&quot; last-run=&quot;1273822976&quot; last-rc-change=&quot;1273820389&quot; exec-time=&quot;1040&quot; queue-time=&quot;0&quot; op-digest=&quot;4029bbaef749649e82d602afb46dd872&quot;/&gt;<br>

          &lt;/lrm_resource&gt;<br>        &lt;/lrm_resources&gt;<br>      &lt;/lrm&gt;<br>    &lt;/node_state&gt;<br>  &lt;/status&gt;<br>&lt;/cib&gt;<br><br><br><br><br>
</blockquote></div><br><br clear="all"><br>-- <br>Javen Wu<br>