[Pacemaker] failcount not being reset?

[Anton Altaparmakov]

Hi,

After a monitor action failure the failcount is not being reset despite everything I am aware off being configured, i.e. I have set (copied from "crm configure show"):

property \
	cluster-recheck-interval="60s"
rsc_defaults $id="rsc-options" \
	failure-timeout="60s"

Yes "crm_mon --failcounts" shows:

* Node nessie: 
   res_drbd:0: migration-threshold=1000000 fail-count=2 last-failure='Mon Jan 31 14:27:14 2011'

However the logs say that:

Jan 31 15:41:27 nessie pengine: [1070]: info: get_failcount: ms_drbd has failed 2 times on nessie
Jan 31 15:41:27 nessie pengine: [1070]: notice: get_failcount: Failcount for ms_drbd on nessie has expired (limit was 60s)

So why does fail-count not go back to zero and disappear?  Am I doing something wrong?  Is it broken?  Am I missing some option?

Note this is running on Ubuntu 10.04.1 LTS and the relevant packages are:

pacemaker 1.0.8+hg15494-2ubuntu2
corosync 1.2.0-0ubuntu1
drbd8-utils 2:8.3.7-1ubuntu2.1

And here is the full configuration (crm configure show):

node hydra
node nessie
node qs1
primitive res_drbd ocf:linbit:drbd \
	params drbd_resource="dev-vmstore" \
	meta target-role="Started" \
	op monitor interval="9s" role="Master" on-fail="restart" \
	op monitor interval="10s" role="Slave" on-fail="restart"
primitive res_filesystem ocf:heartbeat:Filesystem \
	params fstype="xfs" device="/dev/drbd0" directory="/dev-vmstore" options="noatime,barrier,largeio,logbufs=8,logbsize=256k,swalloc" \
	meta target-role="Started" \
	op monitor on-fail="restart" interval="10s"
primitive res_ip ocf:heartbeat:IPaddr2 \
	params ip="172.28.208.19" cidr_netmask="24" broadcast="172.28.208.255" \
	meta target-role="Started" \
	op monitor on-fail="restart" interval="10s"
primitive res_nfs_server lsb:nfs-kernel-server \
	meta target-role="Started" \
	op monitor on-fail="restart" interval="10s"
group group_dev-vmstore res_filesystem res_nfs_server res_ip
ms ms_drbd res_drbd \
	meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" globally_unique="false"
location loc_dev-vmstore_hydra group_dev-vmstore 0: hydra
location loc_dev-vmstore_nessie group_dev-vmstore 0: nessie
location loc_drbd_hydra ms_drbd 0: hydra
location loc_drbd_nessie ms_drbd 0: nessie
colocation col_dev-vmstore inf: group_dev-vmstore ms_drbd:Master
order order_dev-vmstore inf: ms_drbd:promote group_dev-vmstore:start
property $id="cib-bootstrap-options" \
	dc-version="1.0.8-042548a451fce8400660f6031f4da6f0223dd5dd" \
	cluster-infrastructure="openais" \
	expected-quorum-votes="3" \
	stonith-enabled="false" \
	no-quorum-policy="stop" \
	symmetric-cluster="false" \
	pe-error-series-max="100" \
	pe-warn-series-max="100" \
	pe-input-series-max="100" \
	cluster-delay="10s" \
	last-lrm-refresh="1296433757" \
	cluster-recheck-interval="60s"
rsc_defaults $id="rsc-options" \
	failure-timeout="60s"
op_defaults $id="op_defaults-options" \
	timeout="5s"

Thanks a lot in advance for any help!

Best regards,

	Anton
-- 
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/