[Pacemaker] Orphaned resources

[Thilo Uttendorfer]

Hi,

on several pacemaker clusters I sometimes see ORPHANED (DRBD) resources. In 
some cases they exist only for a short time and are automatically removed. 
But in other cases the resource will fail. "crm status" then looks like that:

 Master/Slave Set: ms-res1 [drbd-res1]
     drbd-res1:0     (ocf::linbit:drbd):     Master server-v2.linux-ag.com 
(unmanaged) FAILED
     drbd-res1:2     (ocf::linbit:drbd):      ORPHANED Master 
server-v2.linux-ag.com (unmanaged) FAILED
     Slaves: [ server-v1.linux-ag.com ]

This happens although DRBD is running fine without any problems.
The pacemaker log shows entries like this:

Apr 25 20:07:46 server-v2 pengine: [21702]: notice: LogActions: Leave   
drbd-res1:0#011(Master server-v2.linux-ag.com)          
Apr 25 20:07:46 server-v2 pengine: [21702]: notice: LogActions: Start   
drbd-res1:1#011(server-v1.linux-ag.com)                 
Apr 25 20:07:46 server-v2 pengine: [21702]: notice: LogActions: Stop    
drbd-res1:2#011(server-v2.linux-ag.com)                 
                                                                                                                                
Apr 25 20:07:48 server-v2 pengine: [21702]: notice: LogActions: Leave   
drbd-res1:0#011(Master server-v2.linux-ag.com)          
Apr 25 20:07:48 server-v2 pengine: [21702]: notice: LogActions: Leave   
drbd-res1:1#011(Slave server-v1.linux-ag.com)
Apr 25 20:07:48 server-v2 pengine: [21702]: notice: LogActions: Stop    
drbd-res1:2#011(server-v2.linux-ag.com)


In what cases are ORPHANS created? How are they usually handled or how can I 
get rid of them? How could I debug this situation, e.g. which log entires are 
of interest?

I suppose that these ORPHANS (sometimes) appear after a cluster node was 
offline (or in maintenance mode) and then rejoins the cluster. But not too 
sure about that...


The clusters are based on Ubuntu 10.04 LTS with
 - heartbeat 3.0.5
 - pacemaker 1.1.6



Thanks for any hint,
Thilo


-- 
Thilo Uttendorfer
Linux Information Systems AG
Putzbrunner Str. 71, 81739 München

Fon: +49 89 993412-11, Fax: +49 89 993412-99
t.uttendorfer at linux-ag.com, http://www.linux-ag.com