[Pacemaker] Cotrolled migration of resources

[Matthew F. Hymowitz]

I am building a two node active/passive cluster supporting iSCSITarget,iSCSILogicalUnit and ocf:linbit:drbd.   I can hard power down a primary node (i.e. pull the power cord ) and all my resource migrate correctly to the other node.   However, if I try to migrate the resoruces, put an active node in standby or shut a system down gracefully DRBD compalains to the console that drbd0 is held open by someone (it is wanting to switch to seocndary/secondary) . I followed  the example here:
http://www.drbd.org/users-guide/s-pacemaker-crm.html and converted resources from filesystem to iscsi.   I can not figure out what is wrong with my order or colocation statements.  I tried every permutaition of ordering that I could think of.   Both systems are running debian/sid with corosync version 1.2.1  and pacemaker version loaded from the debian repository.  The kernel is version 2.6.34 with liotarget support built in.   Any help that any could provide would be greatly appreciated.   Thank you.   Here is my config:


node sedona \
        attributes standby="off"
node toltec \
        attributes standby="off"
primitive drbdWitnessDisk ocf:linbit:drbd \
        params drbd_resource="witnessdisk" \
        op monitor interval="59s" role="Master" timeout="30s" \
        op monitor interval="60s" role="Slave" timeout="30s" \
        op start interval="0s" timeout="240s" \
        op stop interval="0s" timeout="100"
primitive ip_iscsi ocf:heartbeat:IPaddr2 \
        params ip="192.168.7.5" nic="eth0"
primitive iscsiTarget ocf:heartbeat:iSCSITarget \
        params implementation="lio" iqn="iqn.2003-01.org.linux-iscsi.sedona.x86:sn.e6c51b908732" portals="192.168.7.5:3260" allowed_initiators="iqn.1991-05.com.microsoft:black-bear.****.local" \
        op monitor interval="10s" timeout="10s"
primitive sedona-stonith stonith:external/ipmi \
        params hostname="sedona.********.com" ipaddr="192.168.7.10" userid="admin" passwd="**********" interface="lan" \
        op start interval="0s" timeout="60s" \
        meta target-role="Started"
primitive toltec-stonith stonith:external/ssh \
        params hostlist="toltec" livedangerously="yes" \
        meta target-role="Started" \
        op start interval="0s" timeout="60s"
primitive witnessDiskLU ocf:heartbeat:iSCSILogicalUnit \
        params implementation="lio" target_iqn="iqn.2003-01.org.linux-iscsi.sedona.x86:sn.e6c51b908732" lun="0" path="/dev/drbd0"
group iscsi witnessDiskLU ip_iscsi iscsiTarget \
        meta target-role="Started"
ms ms-drbdWitnessDisk drbdWitnessDisk \
        meta clone-max="2" notify="true" globally-unique="false" target-role="Started"
location cli-standby-iscsi iscsi \
        rule $id="cli-standby-rule-iscsi" -inf: #uname eq toltec
location ms-drbdWitnessDisk-master-on-sedona-1 ms-drbdWitnessDisk \
        rule $id="ms-drbdWitnessDisk-master-on-sedona-1-rule" $role="master" 100: #uname eq sedona
location ms-drbdWitnessDisk-placement ms-drbdWitnessDisk \
        rule $id="ms-drbdWitnessDisk-placement-rule" -inf: #uname ne sedona and #uname ne toltec
location sedona-stonith-on-toltec sedona-stonith \
        rule $id="sedona-stonith-on-toltec-rule" -INF: #uname eq sedona
location toltec-stonith-on-sedona toltec-stonith \
        rule $id="toltec-stonith-on-sedona-rule" -INF: #uname eq toltec
colocation iscsi-on-msdrbdwitnessDisk inf: iscsi ms-drbdWitnessDisk:Master
order iscsi_after_drbd inf: ms-drbdWitnessDisk:promote iscsi:start symmetrical=true
property $id="cib-bootstrap-options" \
        dc-version="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" \
        cluster-infrastructure="openais" \
        expected-quorum-votes="2" \
        no-quorum-policy="ignore" \
        last-lrm-refresh="1288316571"

Matt Hymowitz
GMP Networks
520 577-3891 x 11
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.clusterlabs.org/pipermail/pacemaker/attachments/20101028/3dcb1fab/attachment-0001.html>