<div dir="ltr"><div><br></div><div>[root@vsan-test2 ~]# rpm -qa | grep pcs</div><div>pcs-0.9.26-10.el6.noarch</div><div>[root@vsan-test2 ~]# rpm -qa | grep ccs</div><div>ccs-0.16.2-63.el6.x86_64</div><div>[root@vsan-test2 ~]# rpm -qa | grep pace</div>
<div>pacemaker-libs-1.1.8-7.el6.x86_64</div><div>pacemaker-cli-1.1.8-7.el6.x86_64</div><div>pacemaker-1.1.8-7.el6.x86_64</div><div>pacemaker-cluster-libs-1.1.8-7.el6.x86_64</div><div>[root@vsan-test2 ~]# rpm -qa | grep coro</div>
<div>corosync-1.4.1-15.el6.x86_64</div><div>corosynclib-1.4.1-15.el6.x86_64</div><div>[root@vsan-test2 ~]# rpm -qa | grep cman</div><div>cman-3.0.12.1-49.el6.x86_64</div><div>[root@vsan-test2 ~]# cat /etc/redhat-release</div>
<div>Red Hat Enterprise Linux Server release 6.4 (Santiago)</div><div>[root@vsan-test2 ~]# uname -a</div><div>Linux vsan-test2 2.6.32-358.el6.x86_64 #1 SMP Tue Jan 29 11:47:41 EST 2013 x86_64 x86_64 x86_64 GNU/Linux</div>
<div><br></div><div>[root@vsan-test2 ~]# pcs status</div><div>Last updated: Tue May 20 08:30:47 2014</div><div>Last change: Tue May 20 08:30:43 2014 via cibadmin on vsan-test2</div><div>Stack: cman</div><div>Current DC: vsan-test2 - partition with quorum</div>
<div>Version: 1.1.8-7.el6-394e906</div><div>2 Nodes configured, unknown expected votes</div><div>2 Resources configured.</div><div><br></div><div><br></div><div>Online: [ vsan-test1 vsan-test2 ]</div><div><br></div><div>Full list of resources:</div>
<div><br></div><div> Master/Slave Set: ms-3e6a5f58-d95e-461f-a376-a5064cecf144 [vha-3e6a5f58-d95e-461f-a376-a5064cecf144]</div><div>     Masters: [ vsan-test1 ]</div><div>     Slaves: [ vsan-test2 ]</div><div><br></div><div>
<br></div><div>[root@vsan-test2 ~]# pcs config</div><div>Corosync Nodes:</div><div><br></div><div>Pacemaker Nodes:</div><div> vsan-test1 vsan-test2</div><div><br></div><div>Resources:</div><div><br></div><div>Location Constraints:</div>
<div>  Resource: vha-3e6a5f58-d95e-461f-a376-a5064cecf144</div><div>    Enabled on: vsan-test2</div><div>    Enabled on: vsan-test1</div><div>  Resource: ms-3e6a5f58-d95e-461f-a376-a5064cecf144</div><div>    Enabled on: vsan-test2</div>
<div>    Enabled on: vsan-test1</div><div>Ordering Constraints:</div><div>Colocation Constraints:</div><div><br></div><div>Cluster Properties:</div><div> dc-version: 1.1.8-7.el6-394e906</div><div> cluster-infrastructure: cman</div>
<div> last-lrm-refresh: 1400492826</div><div> stonith-enabled: false</div><div> no-quorum-policy: ignore</div><div><br></div><div><br></div><div><br></div><div><br></div><div>[root@vsan-test2 ~]# pcs resource delete ms-3e6a5f58-d95e-461f-a376-a5064cecf144</div>
<div>ERROR: Unable to update cib</div><div>Call cib_replace failed (-1003): Update does not conform to the configured schema</div><div>&lt;cib admin_epoch=&quot;0&quot; cib-last-written=&quot;Tue May 20 08:30:43 2014&quot; crm_feature_set=&quot;3.0.7&quot; dc-uuid=&quot;vsan-test2&quot; epoch=&quot;7893&quot; have-quorum=&quot;1&quot; num_updates=&quot;1&quot; update-client=&quot;cibadmin&quot; update-origin=&quot;vsan-test2&quot; validate-with=&quot;pacemaker-1.2&quot;&gt;</div>
<div>  &lt;configuration&gt;</div><div>    &lt;crm_config&gt;</div><div>      &lt;cluster_property_set id=&quot;cib-bootstrap-options&quot;&gt;</div><div>        &lt;nvpair id=&quot;cib-bootstrap-options-dc-version&quot; name=&quot;dc-version&quot; value=&quot;1.1.8-7.el6-394e906&quot;/&gt;</div>
<div>        &lt;nvpair id=&quot;cib-bootstrap-options-cluster-infrastructure&quot; name=&quot;cluster-infrastructure&quot; value=&quot;cman&quot;/&gt;</div><div>        &lt;nvpair id=&quot;cib-bootstrap-options-last-lrm-refresh&quot; name=&quot;last-lrm-refresh&quot; value=&quot;1400492826&quot;/&gt;</div>
<div>        &lt;nvpair id=&quot;cib-bootstrap-options-stonith-enabled&quot; name=&quot;stonith-enabled&quot; value=&quot;false&quot;/&gt;</div><div>        &lt;nvpair id=&quot;cib-bootstrap-options-no-quorum-policy&quot; name=&quot;no-quorum-policy&quot; value=&quot;ignore&quot;/&gt;</div>
<div>      &lt;/cluster_property_set&gt;</div><div>    &lt;/crm_config&gt;</div><div>    &lt;nodes&gt;</div><div>      &lt;node id=&quot;vsan-test1&quot; uname=&quot;vsan-test1&quot;/&gt;</div><div>      &lt;node id=&quot;vsan-test2&quot; uname=&quot;vsan-test2&quot;/&gt;</div>
<div>    &lt;/nodes&gt;</div><div>    &lt;resources/&gt;</div><div>    &lt;constraints&gt;</div><div>      &lt;rsc_location id=&quot;location-vha-3e6a5f58-d95e-461f-a376-a5064cecf144-vsan-test2-INFINITY&quot; node=&quot;vsan-test2&quot; rsc=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; score=&quot;INFINITY&quot;/&gt;</div>
<div>      &lt;rsc_location id=&quot;location-vha-3e6a5f58-d95e-461f-a376-a5064cecf144-vsan-test1-INFINITY&quot; node=&quot;vsan-test1&quot; rsc=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; score=&quot;INFINITY&quot;/&gt;</div>
<div>      &lt;rsc_location id=&quot;location-ms-3e6a5f58-d95e-461f-a376-a5064cecf144-vsan-test2-INFINITY&quot; node=&quot;vsan-test2&quot; rsc=&quot;ms-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; score=&quot;INFINITY&quot;/&gt;</div>
<div>      &lt;rsc_location id=&quot;location-ms-3e6a5f58-d95e-461f-a376-a5064cecf144-vsan-test1-INFINITY&quot; node=&quot;vsan-test1&quot; rsc=&quot;ms-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; score=&quot;INFINITY&quot;/&gt;</div>
<div>    &lt;/constraints&gt;</div><div>    &lt;rsc_defaults&gt;</div><div>      &lt;meta_attributes id=&quot;rsc_defaults-options&quot;&gt;</div><div>        &lt;nvpair id=&quot;rsc_defaults-options-resource-stickiness&quot; name=&quot;resource-stickiness&quot; value=&quot;100&quot;/&gt;</div>
<div>      &lt;/meta_attributes&gt;</div><div>    &lt;/rsc_defaults&gt;</div><div>  &lt;/configuration&gt;</div><div>  &lt;status&gt;</div><div>    &lt;node_state crm-debug-origin=&quot;do_update_resource&quot; crmd=&quot;online&quot; expected=&quot;member&quot; id=&quot;vsan-test2&quot; in_ccm=&quot;true&quot; join=&quot;member&quot; uname=&quot;vsan-test2&quot;&gt;</div>
<div>      &lt;transient_attributes id=&quot;vsan-test2&quot;&gt;</div><div>        &lt;instance_attributes id=&quot;status-vsan-test2&quot;&gt;</div><div>          &lt;nvpair id=&quot;status-vsan-test2-probe_complete&quot; name=&quot;probe_complete&quot; value=&quot;true&quot;/&gt;</div>
<div>          &lt;nvpair id=&quot;status-vsan-test2-master-vha-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; name=&quot;master-vha-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; value=&quot;3&quot;/&gt;</div><div>        &lt;/instance_attributes&gt;</div>
<div>      &lt;/transient_attributes&gt;</div><div>      &lt;lrm id=&quot;vsan-test2&quot;&gt;</div><div>        &lt;lrm_resources&gt;</div><div>          &lt;lrm_resource id=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; type=&quot;vgc-cm-agent.ocf&quot; class=&quot;ocf&quot; provider=&quot;heartbeat&quot;&gt;</div>
<div>            &lt;lrm_rsc_op id=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144_last_0&quot; operation_key=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144_start_0&quot; operation=&quot;start&quot; crm-debug-origin=&quot;do_update_resource&quot; crm_feature_set=&quot;3.0.7&quot; transition-key=&quot;9:1:0:5916460b-c0c3-4bd0-9e9a-845dc8745f2c&quot; transition-magic=&quot;0:0;9:1:0:5916460b-c0c3-4bd0-9e9a-845dc8745f2c&quot; call-id=&quot;9&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;0&quot; last-run=&quot;1400599846&quot; last-rc-change=&quot;0&quot; exec-time=&quot;108&quot; queue-time=&quot;0&quot; op-digest=&quot;7bb186e694658d06bedbfcf9fb962098&quot;/&gt;</div>
<div>            &lt;lrm_rsc_op id=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144_monitor_31000&quot; operation_key=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144_monitor_31000&quot; operation=&quot;monitor&quot; crm-debug-origin=&quot;do_update_resource&quot; crm_feature_set=&quot;3.0.7&quot; transition-key=&quot;7:2:0:5916460b-c0c3-4bd0-9e9a-845dc8745f2c&quot; transition-magic=&quot;0:0;7:2:0:5916460b-c0c3-4bd0-9e9a-845dc8745f2c&quot; call-id=&quot;12&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;31000&quot; last-rc-change=&quot;0&quot; exec-time=&quot;57&quot; queue-time=&quot;0&quot; op-digest=&quot;e3a7ce7334d52de15f8b2480d2d72ad3&quot;/&gt;</div>
<div>          &lt;/lrm_resource&gt;</div><div>        &lt;/lrm_resources&gt;</div><div>      &lt;/lrm&gt;</div><div>    &lt;/node_state&gt;</div><div>    &lt;node_state crm-debug-origin=&quot;do_update_resource&quot; crmd=&quot;online&quot; expected=&quot;member&quot; id=&quot;vsan-test1&quot; in_ccm=&quot;true&quot; join=&quot;member&quot; uname=&quot;vsan-test1&quot;&gt;</div>
<div>      &lt;transient_attributes id=&quot;vsan-test1&quot;&gt;</div><div>        &lt;instance_attributes id=&quot;status-vsan-test1&quot;&gt;</div><div>          &lt;nvpair id=&quot;status-vsan-test1-probe_complete&quot; name=&quot;probe_complete&quot; value=&quot;true&quot;/&gt;</div>
<div>          &lt;nvpair id=&quot;status-vsan-test1-master-vha-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; name=&quot;master-vha-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; value=&quot;4&quot;/&gt;</div><div>        &lt;/instance_attributes&gt;</div>
<div>      &lt;/transient_attributes&gt;</div><div>      &lt;lrm id=&quot;vsan-test1&quot;&gt;</div><div>        &lt;lrm_resources&gt;</div><div>          &lt;lrm_resource id=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144&quot; type=&quot;vgc-cm-agent.ocf&quot; class=&quot;ocf&quot; provider=&quot;heartbeat&quot;&gt;</div>
<div>            &lt;lrm_rsc_op id=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144_last_0&quot; operation_key=&quot;vha-3e6a5f58-d95e-461f-a376-a5064cecf144_promote_0&quot; operation=&quot;promote&quot; crm-debug-origin=&quot;do_update_resource&quot; crm_feature_set=&quot;3.0.7&quot; transition-key=&quot;10:2:0:5916460b-c0c3-4bd0-9e9a-845dc8745f2c&quot; transition-magic=&quot;0:0;10:2:0:5916460b-c0c3-4bd0-9e9a-845dc8745f2c&quot; call-id=&quot;12&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;0&quot; last-run=&quot;1400599846&quot; last-rc-change=&quot;0&quot; exec-time=&quot;171&quot; queue-time=&quot;0&quot; op-digest=&quot;7bb186e694658d06bedbfcf9fb962098&quot;/&gt;</div>
<div>          &lt;/lrm_resource&gt;</div><div>        &lt;/lrm_resources&gt;</div><div>      &lt;/lrm&gt;</div><div>    &lt;/node_state&gt;</div><div>  &lt;/status&gt;</div><div>&lt;/cib&gt;</div><div><br></div><div><br>
</div><div><br></div><div>[root@vsan-test2 ~]# pcs status</div><div>Last updated: Tue May 20 08:32:42 2014</div><div>Last change: Tue May 20 08:30:43 2014 via cibadmin on vsan-test2</div><div>Stack: cman</div><div>Current DC: vsan-test2 - partition with quorum</div>
<div>Version: 1.1.8-7.el6-394e906</div><div>2 Nodes configured, unknown expected votes</div><div>2 Resources configured.</div><div><br></div><div><br></div><div>Online: [ vsan-test1 vsan-test2 ]</div><div><br></div><div>Full list of resources:</div>
<div><br></div><div> Master/Slave Set: ms-3e6a5f58-d95e-461f-a376-a5064cecf144 [vha-3e6a5f58-d95e-461f-a376-a5064cecf144]</div><div>     Masters: [ vsan-test1 ]</div><div>     Slaves: [ vsan-test2 ]</div><div><br></div><div>
[root@vsan-test2 ~]# pcs resource unclone ms-3e6a5f58-d95e-461f-a376-a5064cecf144</div><div>Error: could not find resource or group: ms-3e6a5f58-d95e-461f-a376-a5064cecf144</div><div><br></div><div><br></div><div><br></div>
<div>[root@vsan-test2 ~]# pcs status</div><div>Last updated: Tue May 20 08:33:07 2014</div><div>Last change: Tue May 20 08:30:43 2014 via cibadmin on vsan-test2</div><div>Stack: cman</div><div>Current DC: vsan-test2 - partition with quorum</div>
<div>Version: 1.1.8-7.el6-394e906</div><div>2 Nodes configured, unknown expected votes</div><div>2 Resources configured.</div><div><br></div><div><br></div><div>Online: [ vsan-test1 vsan-test2 ]</div><div><br></div><div>Full list of resources:</div>
<div><br></div><div> Master/Slave Set: ms-3e6a5f58-d95e-461f-a376-a5064cecf144 [vha-3e6a5f58-d95e-461f-a376-a5064cecf144]</div><div>     Masters: [ vsan-test1 ]</div><div>     Slaves: [ vsan-test2 ]</div><div><br></div><div>
[root@vsan-test2 ~]# pcs resource delete vha-3e6a5f58-d95e-461f-a376-a5064cecf144</div><div>Removing Constraint - location-ms-3e6a5f58-d95e-461f-a376-a5064cecf144-vsan-test2-INFINITY</div><div>Removing Constraint - location-ms-3e6a5f58-d95e-461f-a376-a5064cecf144-vsan-test1-INFINITY</div>
<div>Removing Constraint - location-vha-3e6a5f58-d95e-461f-a376-a5064cecf144-vsan-test2-INFINITY</div><div>Removing Constraint - location-vha-3e6a5f58-d95e-461f-a376-a5064cecf144-vsan-test1-INFINITY</div><div>Deleting Resource - vha-3e6a5f58-d95e-461f-a376-a5064cecf144</div>
<div>[root@vsan-test2 ~]# pcs status</div><div>Last updated: Tue May 20 08:33:22 2014</div><div>Last change: Tue May 20 08:33:19 2014 via cibadmin on vsan-test2</div><div>Stack: cman</div><div>Current DC: vsan-test2 - partition with quorum</div>
<div>Version: 1.1.8-7.el6-394e906</div><div>2 Nodes configured, unknown expected votes</div><div>0 Resources configured.</div><div><br></div><div><br></div><div>Online: [ vsan-test1 vsan-test2 ]</div><div><br></div><div>Full list of resources:</div>
<div><br></div><div> vha-3e6a5f58-d95e-461f-a376-a5064cecf144       (ocf::heartbeat:vgc-cm-agent.ocf):       ORPHANED Started vsan-test2    &lt;&lt;&lt;&lt;&lt;</div><div><br></div><div><br></div><div><br></div><div><br></div>
<div>Regards,</div><div> Kiran</div><div><br></div></div>