<div dir="ltr">No reason. Need to know which combination is expected to work.<div>using 0.9.26 with new 1.1.10 pacemaker</div><div>and 0.9.90 with old pacemaker has issues in resource deletion.</div><div><br></div><div>Below is the commands executed on 0.9.26 with 1.1.10 pacemaker </div>
<div><br></div><div><div>[root@vsanqa11 tmp]# rpm -qa | grep pcs; rpm -qa | grep pacemaker; rpm -qa | grep corosync; rpm -qa | grep libqb</div><div>pcs-0.9.26-10.el6.noarch</div><div>pacemaker-cli-1.1.10-14.el6_5.3.x86_64</div>
<div>pacemaker-libs-1.1.10-14.el6_5.3.x86_64</div><div>pacemaker-1.1.10-14.el6_5.3.x86_64</div><div>pacemaker-cluster-libs-1.1.10-14.el6_5.3.x86_64</div><div>corosynclib-1.4.1-17.el6_5.1.x86_64</div><div>corosync-1.4.1-17.el6_5.1.x86_64</div>
<div>libqb-devel-0.16.0-2.el6.x86_64</div><div>libqb-0.16.0-2.el6.x86_64</div><div><br></div><div><br></div><div>[root@vsanqa11 tmp]# pcs status</div><div>Last updated: Mon May 26 22:39:42 2014</div><div>Last change: Mon May 26 22:39:01 2014 via cibadmin on vsanqa11</div>
<div>Stack: cman</div><div>Current DC: vsanqa11 - partition with quorum</div><div>Version: 1.1.10-14.el6_5.3-368c726</div><div>2 Nodes configured</div><div>2 Resources configured</div><div><br></div><div><br></div><div>Online: [ vsanqa11 vsanqa12 ]</div>
<div><br></div><div>Full list of resources:</div><div><br></div><div> Master/Slave Set: ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a [vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a]</div><div>     Masters: [ vsanqa12 ]</div><div>     Slaves: [ vsanqa11 ]</div>
<div><br></div><div><br></div><div><br></div><div>[root@vsanqa11 tmp]# pcs config</div><div>Corosync Nodes:</div><div><br></div><div>Pacemaker Nodes:</div><div> vsanqa11 vsanqa12</div><div><br></div><div>Resources:</div><div>
<br></div><div>Location Constraints:</div><div>  Resource: ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div><div>    Enabled on: vsanqa11</div><div>    Enabled on: vsanqa12</div><div>  Resource: vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div>
<div>    Enabled on: vsanqa11</div><div>    Enabled on: vsanqa12</div><div>Ordering Constraints:</div><div>Colocation Constraints:</div><div><br></div><div>Cluster Properties:</div><div> dc-version: 1.1.10-14.el6_5.3-368c726</div>
<div> cluster-infrastructure: cman</div><div> last-lrm-refresh: 1401098102</div><div> expected-quorum-votes: 2</div><div> stonith-enabled: false</div><div> no-quorum-policy: ignore</div><div><br></div><div><br></div><div>
<br></div><div>[root@vsanqa11 tmp]# pcs resource show ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div><div>Resource: ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div><div>  cluster_uuid: 9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div>
<div>  clone-max: 2</div><div>  globally-unique: false</div><div>  target-role: started</div><div>  op monitor interval=31s role=Slave timeout=100s</div><div>[root@vsanqa11 tmp]# pcs resource show vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div>
<div>Resource: vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div><div>  cluster_uuid: 9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div><div>  op monitor interval=31s role=Slave timeout=100s</div><div><br></div><div><br></div><div>[root@vsanqa11 tmp]# pcs resource delete ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div>
<div>ERROR: Unable to update cib</div><div>Call cib_replace failed (-203): Update does not conform to the configured schema</div><div>&lt;cib admin_epoch=&quot;0&quot; cib-last-written=&quot;Mon May 26 22:40:45 2014&quot; crm_feature_set=&quot;3.0.7&quot; dc-uuid=&quot;vsanqa11&quot; epoch=&quot;10550&quot; have-quorum=&quot;1&quot; num_updates=&quot;1&quot; update-client=&quot;cibadmin&quot; update-origin=&quot;vsanqa11&quot; validate-with=&quot;pacemaker-1.2&quot;&gt;</div>
<div>  &lt;configuration&gt;</div><div>    &lt;crm_config&gt;</div><div>      &lt;cluster_property_set id=&quot;cib-bootstrap-options&quot;&gt;</div><div>        &lt;nvpair id=&quot;cib-bootstrap-options-dc-version&quot; name=&quot;dc-version&quot; value=&quot;1.1.10-14.el6_5.3-368c726&quot;/&gt;</div>
<div>        &lt;nvpair id=&quot;cib-bootstrap-options-cluster-infrastructure&quot; name=&quot;cluster-infrastructure&quot; value=&quot;cman&quot;/&gt;</div><div>        &lt;nvpair id=&quot;cib-bootstrap-options-last-lrm-refresh&quot; name=&quot;last-lrm-refresh&quot; value=&quot;1401098102&quot;/&gt;</div>
<div>        &lt;nvpair id=&quot;cib-bootstrap-options-expected-quorum-votes&quot; name=&quot;expected-quorum-votes&quot; value=&quot;2&quot;/&gt;</div><div>        &lt;nvpair id=&quot;cib-bootstrap-options-stonith-enabled&quot; name=&quot;stonith-enabled&quot; value=&quot;false&quot;/&gt;</div>
<div>        &lt;nvpair id=&quot;cib-bootstrap-options-no-quorum-policy&quot; name=&quot;no-quorum-policy&quot; value=&quot;ignore&quot;/&gt;</div><div>      &lt;/cluster_property_set&gt;</div><div>    &lt;/crm_config&gt;</div>
<div>    &lt;nodes&gt;</div><div>      &lt;node id=&quot;vsanqa11&quot; uname=&quot;vsanqa11&quot;/&gt;</div><div>      &lt;node id=&quot;vsanqa12&quot; uname=&quot;vsanqa12&quot;/&gt;</div><div>    &lt;/nodes&gt;</div><div>
    &lt;resources/&gt;</div><div>    &lt;constraints&gt;</div><div>      &lt;rsc_location id=&quot;location-vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a-vsanqa11-INFINITY&quot; node=&quot;vsanqa11&quot; rsc=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; score=&quot;INFINITY&quot;/&gt;</div>
<div>      &lt;rsc_location id=&quot;location-vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a-vsanqa12-INFINITY&quot; node=&quot;vsanqa12&quot; rsc=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; score=&quot;INFINITY&quot;/&gt;</div>
<div>      &lt;rsc_location id=&quot;location-ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a-vsanqa11-INFINITY&quot; node=&quot;vsanqa11&quot; rsc=&quot;ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; score=&quot;INFINITY&quot;/&gt;</div>
<div>      &lt;rsc_location id=&quot;location-ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a-vsanqa12-INFINITY&quot; node=&quot;vsanqa12&quot; rsc=&quot;ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; score=&quot;INFINITY&quot;/&gt;</div>
<div>    &lt;/constraints&gt;</div><div>    &lt;rsc_defaults&gt;</div><div>      &lt;meta_attributes id=&quot;rsc_defaults-options&quot;&gt;</div><div>        &lt;nvpair id=&quot;rsc_defaults-options-resource-stickiness&quot; name=&quot;resource-stickiness&quot; value=&quot;100&quot;/&gt;</div>
<div>        &lt;nvpair id=&quot;rsc_defaults-options-timeout&quot; name=&quot;timeout&quot; value=&quot;100s&quot;/&gt;</div><div>      &lt;/meta_attributes&gt;</div><div>    &lt;/rsc_defaults&gt;</div><div>  &lt;/configuration&gt;</div>
<div>  &lt;status&gt;</div><div>    &lt;node_state crm-debug-origin=&quot;do_update_resource&quot; crmd=&quot;online&quot; expected=&quot;member&quot; id=&quot;vsanqa11&quot; in_ccm=&quot;true&quot; join=&quot;member&quot; uname=&quot;vsanqa11&quot;&gt;</div>
<div>      &lt;transient_attributes id=&quot;vsanqa11&quot;&gt;</div><div>        &lt;instance_attributes id=&quot;status-vsanqa11&quot;&gt;</div><div>          &lt;nvpair id=&quot;status-vsanqa11-probe_complete&quot; name=&quot;probe_complete&quot; value=&quot;true&quot;/&gt;</div>
<div>          &lt;nvpair id=&quot;status-vsanqa11-master-vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; name=&quot;master-vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; value=&quot;4&quot;/&gt;</div><div>        &lt;/instance_attributes&gt;</div>
<div>      &lt;/transient_attributes&gt;</div><div>      &lt;lrm id=&quot;vsanqa11&quot;&gt;</div><div>        &lt;lrm_resources&gt;</div><div>          &lt;lrm_resource id=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; type=&quot;vgc-cm-agent.ocf&quot; class=&quot;ocf&quot; provider=&quot;heartbeat&quot;&gt;</div>
<div>            &lt;lrm_rsc_op id=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a_last_0&quot; operation_key=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a_start_0&quot; operation=&quot;start&quot; crm-debug-origin=&quot;do_update_resource&quot; crm_feature_set=&quot;3.0.7&quot; transition-key=&quot;7:195:0:79ecdaeb-e637-4fdf-b8e8-ebfc7e2eca39&quot; transition-magic=&quot;0:0;7:195:0:79ecdaeb-e637-4fdf-b8e8-ebfc7e2eca39&quot; call-id=&quot;290&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;0&quot; last-run=&quot;1401169141&quot; last-rc-change=&quot;1401169141&quot; exec-time=&quot;1103&quot; queue-time=&quot;0&quot; op-digest=&quot;494c7d757cceae4f35487404ebc12a10&quot;/&gt;</div>
<div>            &lt;lrm_rsc_op id=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a_monitor_31000&quot; operation_key=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a_monitor_31000&quot; operation=&quot;monitor&quot; crm-debug-origin=&quot;do_update_resource&quot; crm_feature_set=&quot;3.0.7&quot; transition-key=&quot;8:195:0:79ecdaeb-e637-4fdf-b8e8-ebfc7e2eca39&quot; transition-magic=&quot;0:0;8:195:0:79ecdaeb-e637-4fdf-b8e8-ebfc7e2eca39&quot; call-id=&quot;293&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;31000&quot; last-rc-change=&quot;1401169142&quot; exec-time=&quot;76&quot; queue-time=&quot;0&quot; op-digest=&quot;f81bd1d7870f6bb69f88312740132d65&quot;/&gt;</div>
<div>          &lt;/lrm_resource&gt;</div><div>        &lt;/lrm_resources&gt;</div><div>      &lt;/lrm&gt;</div><div>    &lt;/node_state&gt;</div><div>    &lt;node_state crm-debug-origin=&quot;do_update_resource&quot; crmd=&quot;online&quot; expected=&quot;member&quot; id=&quot;vsanqa12&quot; in_ccm=&quot;true&quot; join=&quot;member&quot; uname=&quot;vsanqa12&quot;&gt;</div>
<div>      &lt;transient_attributes id=&quot;vsanqa12&quot;&gt;</div><div>        &lt;instance_attributes id=&quot;status-vsanqa12&quot;&gt;</div><div>          &lt;nvpair id=&quot;status-vsanqa12-probe_complete&quot; name=&quot;probe_complete&quot; value=&quot;true&quot;/&gt;</div>
<div>          &lt;nvpair id=&quot;status-vsanqa12-master-vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; name=&quot;master-vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; value=&quot;5&quot;/&gt;</div><div>        &lt;/instance_attributes&gt;</div>
<div>      &lt;/transient_attributes&gt;</div><div>      &lt;lrm id=&quot;vsanqa12&quot;&gt;</div><div>        &lt;lrm_resources&gt;</div><div>          &lt;lrm_resource id=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a&quot; type=&quot;vgc-cm-agent.ocf&quot; class=&quot;ocf&quot; provider=&quot;heartbeat&quot;&gt;</div>
<div>            &lt;lrm_rsc_op id=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a_last_0&quot; operation_key=&quot;vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a_promote_0&quot; operation=&quot;promote&quot; crm-debug-origin=&quot;do_update_resource&quot; crm_feature_set=&quot;3.0.7&quot; transition-key=&quot;11:196:0:79ecdaeb-e637-4fdf-b8e8-ebfc7e2eca39&quot; transition-magic=&quot;0:0;11:196:0:79ecdaeb-e637-4fdf-b8e8-ebfc7e2eca39&quot; call-id=&quot;275&quot; rc-code=&quot;0&quot; op-status=&quot;0&quot; interval=&quot;0&quot; last-run=&quot;1401169174&quot; last-rc-change=&quot;1401169174&quot; exec-time=&quot;196&quot; queue-time=&quot;0&quot; op-digest=&quot;494c7d757cceae4f35487404ebc12a10&quot;/&gt;</div>
<div>          &lt;/lrm_resource&gt;</div><div>        &lt;/lrm_resources&gt;</div><div>      &lt;/lrm&gt;</div><div>    &lt;/node_state&gt;</div><div>  &lt;/status&gt;</div><div>&lt;/cib&gt;</div><div><br></div><div><br>
</div><div>****deleted on base (non clone) resource works however it stays in orphaned state for few seconds</div><div><br></div><div>[root@vsanqa11 tmp]# pcs resource delete vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a; pcs status</div>
<div>Removing Constraint - location-ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a-vsanqa11-INFINITY</div><div>Removing Constraint - location-ms-9fc36888-cf2a-417a-907c-db3f5e9b7a8a-vsanqa12-INFINITY</div><div>Removing Constraint - location-vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a-vsanqa11-INFINITY</div>
<div>Removing Constraint - location-vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a-vsanqa12-INFINITY</div><div>Deleting Resource - vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a</div><div>Last updated: Mon May 26 22:41:08 2014</div><div>
Last change: Mon May 26 22:41:07 2014 via cibadmin on vsanqa11</div><div>Stack: cman</div><div>Current DC: vsanqa11 - partition with quorum</div><div>Version: 1.1.10-14.el6_5.3-368c726</div><div>2 Nodes configured</div><div>
0 Resources configured</div><div><br></div><div><br></div><div>Online: [ vsanqa11 vsanqa12 ]</div><div><br></div><div>Full list of resources:</div><div><br></div><div> vha-9fc36888-cf2a-417a-907c-db3f5e9b7a8a       (ocf::heartbeat:vgc-cm-agent.ocf):       ORPHANED Master [ vsanqa11 vsanqa12 ]</div>
<div><br></div><div>[root@vsanqa11 tmp]# pcs status</div><div>Last updated: Mon May 26 22:41:18 2014</div><div>Last change: Mon May 26 22:41:07 2014 via cibadmin on vsanqa11</div><div>Stack: cman</div><div>Current DC: vsanqa11 - partition with quorum</div>
<div>Version: 1.1.10-14.el6_5.3-368c726</div><div>2 Nodes configured</div><div>0 Resources configured</div><div><br></div><div><br></div><div>Online: [ vsanqa11 vsanqa12 ]</div><div><br></div><div>Full list of resources:</div>
</div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, May 27, 2014 at 11:01 AM, Andrew Beekhof <span dir="ltr">&lt;<a href="mailto:andrew@beekhof.net" target="_blank">andrew@beekhof.net</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class=""><br>
On 27 May 2014, at 2:34 pm, K Mehta &lt;<a href="mailto:kiranmehta1981@gmail.com">kiranmehta1981@gmail.com</a>&gt; wrote:<br>
<br>
&gt; I have seen that 0.9.26 works with 1.1.8 pacemaker and 0.9.90 works with 1.1.10 pacemaker.<br>
&gt; However, with 0.9.90 pcs and 1.1.8 pacemaker, pcs delete resource &lt;multistate resource name&gt; fails with error CIB update failed because of schema error<br>
<br>
</div>Any specific reason to stay on 1.1.8?<br>
<div class="HOEnZb"><div class="h5"><br>
&gt;<br>
&gt;<br>
&gt; On Tue, May 27, 2014 at 5:28 AM, Andrew Beekhof &lt;<a href="mailto:andrew@beekhof.net">andrew@beekhof.net</a>&gt; wrote:<br>
&gt;<br>
&gt; On 26 May 2014, at 5:15 pm, K Mehta &lt;<a href="mailto:kiranmehta1981@gmail.com">kiranmehta1981@gmail.com</a>&gt; wrote:<br>
&gt;<br>
&gt; &gt; pcs versions 0.9.26 and 0.9.90<br>
&gt; &gt; pacemaker versions 1.1.8 and 1.1.10<br>
&gt; &gt;<br>
&gt; &gt; Which pcs versions are expected to work with which pacemaker versions ?<br>
&gt;<br>
&gt; I think for the most part, all versions will work together.<br>
&gt; There may be the odd command that requires a flag exposed by newer versions of pacemaker, but that should be minimal.<br>
&gt;<br>
&gt; &gt;<br>
&gt; &gt;<br>
&gt; &gt; Regards,<br>
&gt; &gt;  Kiran<br>
&gt; &gt; _______________________________________________<br>
&gt; &gt; Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
&gt; &gt; <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
&gt; &gt;<br>
&gt; &gt; Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
&gt; &gt; Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
&gt; &gt; Bugs: <a href="http://bugs.clusterlabs.org" target="_blank">http://bugs.clusterlabs.org</a><br>
&gt;<br>
&gt;<br>
&gt; _______________________________________________<br>
&gt; Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
&gt; <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
&gt;<br>
&gt; Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
&gt; Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
&gt; Bugs: <a href="http://bugs.clusterlabs.org" target="_blank">http://bugs.clusterlabs.org</a><br>
&gt;<br>
&gt;<br>
&gt; _______________________________________________<br>
&gt; Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
&gt; <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
&gt;<br>
&gt; Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
&gt; Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
&gt; Bugs: <a href="http://bugs.clusterlabs.org" target="_blank">http://bugs.clusterlabs.org</a><br>
<br>
</div></div><br>_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://bugs.clusterlabs.org" target="_blank">http://bugs.clusterlabs.org</a><br>
<br></blockquote></div><br></div>