<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<META NAME="Generator" CONTENT="MS Exchange Server version 6.5.7652.24">
<TITLE>ocf:linbit:drbd monitor failed with stacked resource</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/rtf format -->
<P><FONT SIZE=2 FACE="Arial">Hi list,</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">i configured pacemaker to take care of a three node drbd stetup but the monitor on the stacked drbd resouce failed and the resource never gets started.</FONT></P>
<P><FONT SIZE=2 FACE="Arial">Doing the necessary steps by hand everything works fine (on-node-with-ip: drbdadm --stacked adjust mysqlstack ; drbdadm --stacked primary mysqlstack)</FONT></P>
<P><FONT SIZE=2 FACE="Arial">is it possible that the drbd-monitor can't deal properly the a stacked-resource or do i miss something in my configuration?</FONT></P>
<P><FONT SIZE=2 FACE="Arial">ptest</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
<BR><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:47 info: determine_online_status: Node mysqlHA2.cologne.tecdoc.local is online</FONT>
<BR><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:47 info: unpack_rsc_op: res.drbd.mysqlstack:0_monitor_0 on mysqlHA2.cologne.tecdoc.local returned 6 (not configured) instead of the expected value: 7 (not running)</FONT></P>
<P><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:47 ERROR: unpack_rsc_op: Hard error - res.drbd.mysqlstack:0_monitor_0 failed with rc=6: Preventing ms.drbd.mysqlstack from re-starting anywhere in the cluster</FONT></P>
<P><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:47 info: unpack_rsc_op: res.ip.mysql_monitor_0 on mysqlHA2.cologne.tecdoc.local returned 0 (ok) instead of the expected value: 7 (not running)</FONT></P>
<P><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:47 notice: unpack_rsc_op: Operation res.ip.mysql_monitor_0 found resource res.ip.mysql active on mysqlHA2.cologne.tecdoc.local</FONT></P>
<P><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:47 info: determine_online_status: Node mysqlHA1.cologne.tecdoc.local is online</FONT>
<BR><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:47 info: unpack_rsc_op: res.drbd.mysqlstack:0_monitor_0 on mysqlHA1.cologne.tecdoc.local returned 6 (not configured) instead of the expected value: 7 (not running)</FONT></P>
<P><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:47 ERROR: unpack_rsc_op: Hard error - res.drbd.mysqlstack:0_monitor_0 failed with rc=6: Preventing ms.drbd.mysqlstack from re-starting anywhere in the cluster</FONT></P>
<P><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:48 debug: native_assign_node: All nodes for resource res.drbd.mysqlstack:0 are unavailable, unclean or shutting down (mysqlHA2.cologne.tecdoc.local: 1, -1000000)</FONT></P>
<P><FONT SIZE=2 FACE="Arial">ptest[2395]: 2009/10/19_12:27:48 WARN: native_color: Resource res.drbd.mysqlstack:0 cannot run anywhere</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
</P>
<BR>
<P><FONT SIZE=2 FACE="Arial">crm_mon</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
<BR><FONT SIZE=2 FACE="Arial">============</FONT>
<BR><FONT SIZE=2 FACE="Arial">Last updated: Mon Oct 19 12:10:48 2009</FONT>
<BR><FONT SIZE=2 FACE="Arial">Stack: openais</FONT>
<BR><FONT SIZE=2 FACE="Arial">Current DC: mysqlHA1.cologne.tecdoc.local - partition with quorum</FONT>
<BR><FONT SIZE=2 FACE="Arial">Version: 1.0.5-462f1569a43740667daf7b0f6b521742e9eb8fa7</FONT>
<BR><FONT SIZE=2 FACE="Arial">2 Nodes configured, 2 expected votes</FONT>
<BR><FONT SIZE=2 FACE="Arial">3 Resources configured.</FONT>
<BR><FONT SIZE=2 FACE="Arial">============</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">Online: [ mysqlHA2.cologne.tecdoc.local mysqlHA1.cologne.tecdoc.local ]</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">Master/Slave Set: ms.drbd.mysqldb</FONT>
<BR><FONT SIZE=2 FACE="Arial"> Masters: [ mysqlHA2.cologne.tecdoc.local ]</FONT>
<BR><FONT SIZE=2 FACE="Arial"> Slaves: [ mysqlHA1.cologne.tecdoc.local ]</FONT>
<BR><FONT SIZE=2 FACE="Arial">res.ip.mysql (ocf::heartbeat:IPaddr2): Started mysqlHA2.cologne.tecdoc.local</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">Failed actions:</FONT>
<BR><FONT SIZE=2 FACE="Arial"> res.drbd.mysqlstack:0_monitor_0 (node=(null), call=3, rc=6, status=complete): not configured</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">cat /proc/drbd on node mysqlHA2:</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
<BR><FONT SIZE=2 FACE="Arial">version: 8.3.2 (api:88/proto:86-90)</FONT>
<BR><FONT SIZE=2 FACE="Arial">GIT-hash: dd7985327f146f33b86d4bff5ca8c94234ce840e build by mockbuild@v20z-x86-64.home.local, 2009-08-29 14:07:55</FONT>
<BR><FONT SIZE=2 FACE="Arial"> 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r----</FONT>
<BR><FONT SIZE=2 FACE="Arial"> ns:4 nr:0 dw:0 dr:4 al:0 bm:1 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
</P>
<BR>
<P><FONT SIZE=2 FACE="Arial">her my pacemaker config:</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
<BR><FONT SIZE=2 FACE="Arial">node mysqlHA1.cologne.tecdoc.local</FONT>
<BR><FONT SIZE=2 FACE="Arial">node mysqlHA2.cologne.tecdoc.local</FONT>
<BR><FONT SIZE=2 FACE="Arial">primitive res.drbd.mysqldb ocf:linbit:drbd \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> params drbd_resource="mysqldb"</FONT>
<BR><FONT SIZE=2 FACE="Arial">primitive res.drbd.mysqlstack ocf:linbit:drbd \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> params drbd_resource="mysqlstack" \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> meta target-role="Started"</FONT>
<BR><FONT SIZE=2 FACE="Arial">primitive res.ip.mysql ocf:heartbeat:IPaddr2 \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> params ip="172.30.2.10" nic="eth0" netmask="255.255.255.0"</FONT>
<BR><FONT SIZE=2 FACE="Arial">ms ms.drbd.mysqldb res.drbd.mysqldb \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" globally_unique="false"</FONT>
<BR><FONT SIZE=2 FACE="Arial">ms ms.drbd.mysqlstack res.drbd.mysqlstack \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> meta master-max="1" master-node-max="1" clone-max="1" clone-node-max="1" notify="true" globally_unique="false" t</FONT></P>
<P><FONT SIZE=2 FACE="Arial">colocation co.ms.drbd.mysqlstack_on_ms.drbd.mysqldb inf: ms.drbd.mysqlstack ms.drbd.mysqldb:Master</FONT>
<BR><FONT SIZE=2 FACE="Arial">colocation co.res.ip.mysql_on_ms.drbd.mysqldb_master inf: res.ip.mysql ms.drbd.mysqldb:Master</FONT>
<BR><FONT SIZE=2 FACE="Arial">order o.ip.mysql_before_ms.drbd.mysqlstack inf: res.ip.mysql ms.drbd.mysqlstack:start</FONT>
<BR><FONT SIZE=2 FACE="Arial">order o.ms.drbd.mysqldb_before_ms.drbd.mysqlstack inf: ms.drbd.mysqldb:promote ms.drbd.mysqlstack:start</FONT>
<BR><FONT SIZE=2 FACE="Arial">property $id="cib-bootstrap-options" \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> dc-version="1.0.5-462f1569a43740667daf7b0f6b521742e9eb8fa7" \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> cluster-infrastructure="openais" \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> expected-quorum-votes="2" \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> stonith-enabled="false" \</FONT>
<BR><FONT SIZE=2 FACE="Arial"> last-lrm-refresh="1255946421"</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
</P>
<BR>
<P><FONT SIZE=2 FACE="Arial">drbd.conf</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
<BR><FONT SIZE=2 FACE="Arial">global {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> usage-count no;</FONT>
<BR><FONT SIZE=2 FACE="Arial">}</FONT>
<BR><FONT SIZE=2 FACE="Arial">common {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> syncer {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> rate 10M;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> verify-alg sha1;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial"> protocol C;</FONT>
<BR><FONT SIZE=2 FACE="Arial">}</FONT>
<BR><FONT SIZE=2 FACE="Arial">resource mysqldb {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> handlers {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> fence-peer "/usr/lib/drbd/crm-fence-peer.sh";</FONT>
<BR><FONT SIZE=2 FACE="Arial"> after-resync-target "/usr/lib/drbd/crm-unfence-peer.sh";</FONT>
<BR><FONT SIZE=2 FACE="Arial"> split-brain "/usr/lib/drbd/notify-split-brain.sh root";</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial"> startup {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> degr-wfc-timeout 60; # 1 minute</FONT>
<BR><FONT SIZE=2 FACE="Arial"> outdated-wfc-timeout 2; # 2 seconds.</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial"> disk {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> on-io-error detach;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial"> net {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> cram-hmac-alg "sha1";</FONT>
<BR><FONT SIZE=2 FACE="Arial"> shared-secret "supersecret";</FONT>
<BR><FONT SIZE=2 FACE="Arial"> after-sb-0pri disconnect;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> after-sb-1pri disconnect;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> after-sb-2pri disconnect;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> rr-conflict disconnect;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial"> syncer {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> rate 20M;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> al-extents 257;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial"> device /dev/drbd0;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> disk /dev/sdb;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> meta-disk internal;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> on mysqlHA1.cologne.tecdoc.local {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> address 10.6.0.127:7788;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial"> on mysqlHA2.cologne.tecdoc.local {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> address 10.6.0.128:7788;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial">}</FONT>
<BR><FONT SIZE=2 FACE="Arial">resource mysqlstack {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> protocol A;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> device /dev/drbd10;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> stacked-on-top-of mysqldb {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> address 172.30.2.10:7789; # Cluster IP</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial"> on mysqlHAoffsite.cologne.tecdoc.local {</FONT>
<BR><FONT SIZE=2 FACE="Arial"> disk /dev/sdb;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> address 172.30.2.78:7789; # public IP of backup-node</FONT>
<BR><FONT SIZE=2 FACE="Arial"> meta-disk internal;</FONT>
<BR><FONT SIZE=2 FACE="Arial"> }</FONT>
<BR><FONT SIZE=2 FACE="Arial">}</FONT>
<BR><FONT SIZE=2 FACE="Arial">-------------------------------------------------------------------------------</FONT>
</P>
<P><FONT COLOR="#000000" SIZE=2 FACE="Arial">Mit freundlichen Grüßen / with kind regards</FONT>
</P>
<P><B><FONT COLOR="#000000" FACE="Arial">Torsten Schmidt</FONT></B>
<BR><FONT COLOR="#000000" SIZE=2 FACE="Arial">System Manager</FONT>
</P>
</BODY>
</HTML>