[Pacemaker] Connection to our AIS plugin (9) failed: Library error

Szymon Hersztek szym at globtel.pl
Tue Sep 21 04:03:52 EDT 2010


>>
>> corosync was started manually or do you want to have exact time of  
>> start ?
>
> well you included at most 1 second's worth of logging.
> so its kinda hard to know if something took too long or what recovery
> was attempted.


After 2 minutes
ps auxf  | grep coro -A 8

root      3094  0.0  0.0 195304  3716 ?        Ssl  10:00   0:00  
corosync
root      3100  0.0  0.2  66240 11016 ?        SLs  10:00   0:00  \_ / 
usr/lib64/heartbeat/stonithd
root      3102  0.0  0.0  63028  1852 ?        S    10:00   0:00  \_ / 
usr/lib64/heartbeat/lrmd
100       3104  0.0  0.0  68504  2564 ?        S    10:00   0:00  \_ / 
usr/lib64/heartbeat/pengine
100       3146  0.0  0.0  70164  2512 ?        S    10:01   0:00  \_ / 
usr/lib64/heartbeat/crmd


Debug

Sep 21 10:00:23 corosync [MAIN  ] Corosync Cluster Engine ('1.2.7'):  
started and ready to provide service.
Sep 21 10:00:23 corosync [MAIN  ] Corosync built-in features: nss rdma
Sep 21 10:00:23 corosync [MAIN  ] Successfully read main configuration  
file '/etc/corosync/corosync.conf'.
Sep 21 10:00:23 corosync [TOTEM ] Token Timeout (1000 ms) retransmit  
timeout (238 ms)
Sep 21 10:00:23 corosync [TOTEM ] token hold (180 ms) retransmits  
before loss (4 retrans)
Sep 21 10:00:23 corosync [TOTEM ] join (50 ms) send_join (0 ms)  
consensus (1200 ms) merge (200 ms)
Sep 21 10:00:23 corosync [TOTEM ] downcheck (1000 ms) fail to recv  
const (50 msgs)
Sep 21 10:00:23 corosync [TOTEM ] seqno unchanged const (30 rotations)  
Maximum network MTU 1402
Sep 21 10:00:23 corosync [TOTEM ] window size per rotation (50  
messages) maximum messages per rotation (17 messages)
Sep 21 10:00:23 corosync [TOTEM ] send threads (0 threads)
Sep 21 10:00:23 corosync [TOTEM ] RRP token expired timeout (238 ms)
Sep 21 10:00:23 corosync [TOTEM ] RRP token problem counter (2000 ms)
Sep 21 10:00:23 corosync [TOTEM ] RRP threshold (10 problem count)
Sep 21 10:00:23 corosync [TOTEM ] RRP mode set to none.
Sep 21 10:00:23 corosync [TOTEM ] heartbeat_failures_allowed (0)
Sep 21 10:00:23 corosync [TOTEM ] max_network_delay (50 ms)
Sep 21 10:00:23 corosync [TOTEM ] HeartBeat is Disabled. To enable set  
heartbeat_failures_allowed > 0
Sep 21 10:00:23 corosync [TOTEM ] Initializing transport (UDP/IP).
Sep 21 10:00:23 corosync [TOTEM ] Initializing transmit/receive  
security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
Sep 21 10:00:23 corosync [IPC   ] you are using ipc api v2
Sep 21 10:00:23 corosync [TOTEM ] Receive multicast socket recv buffer  
size (262142 bytes).
Sep 21 10:00:23 corosync [TOTEM ] Transmit multicast socket send  
buffer size (262142 bytes).
Sep 21 10:00:23 corosync [TOTEM ] The network interface  
[192.168.1.212] is now up.
Sep 21 10:00:23 corosync [TOTEM ] Created or loaded sequence id  
4.192.168.1.212 for this ring.
Sep 21 10:00:23 corosync [pcmk  ] debug: pcmk_user_lookup: Cluster  
user root has uid=0 gid=0
Set r/w permissions for uid=0, gid=0 on /var/log/cluster/corosync.log
Sep 21 10:00:23 corosync [pcmk  ] info: process_ais_conf: Reading  
configure
Sep 21 10:00:23 corosync [pcmk  ] info: config_find_init: Local  
handle: 2013064636357672962 for logging
Sep 21 10:00:23 corosync [pcmk  ] info: config_find_next: Processing  
additional logging options...
Sep 21 10:00:23 corosync [pcmk  ] info: get_config_opt: Found 'on' for  
option: debug
Sep 21 10:00:23 corosync [pcmk  ] info: get_config_opt: Found 'yes'  
for option: to_logfile
Sep 21 10:00:23 corosync [pcmk  ] info: get_config_opt: Found '/var/ 
log/cluster/corosync.log' for option: logfile
Sep 21 10:00:23 corosync [pcmk  ] info: get_config_opt: Found 'yes'  
for option: to_syslog
Sep 21 10:00:23 drbd3.xxx.xxx lrmd: [3102]: info:  
G_main_add_SignalHandler: Added signal handler for signal 15
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info:  
G_main_add_SignalHandler: Added signal handler for signal 10
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info:  
G_main_add_SignalHandler: Added signal handler for signal 12
Sep 21 10:00:23 corosync [pcmk  ] info: get_config_opt: Defaulting to  
'daemon' for option: syslog_facility
Sep 21 10:00:23 corosync [pcmk  ] info: config_find_init: Local  
handle: 4730966301143465987 for service
Sep 21 10:00:23 corosync [pcmk  ] info: config_find_next: Processing  
additional service options...
Sep 21 10:00:23 corosync [pcmk  ] info: get_config_opt: Defaulting to  
'pcmk' for option: clustername
Sep 21 10:00:23 corosync [pcmk  ] info: get_config_opt: Defaulting to  
'no' for option: use_logd
Sep 21 10:00:23 corosync [pcmk  ] info: get_config_opt: Defaulting to  
'no' for option: use_mgmtd
Sep 21 10:00:23 corosync [pcmk  ] info: pcmk_startup: CRM: Initialized
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: info: Invoked: /usr/lib64/ 
heartbeat/cib
Sep 21 10:00:23 corosync [pcmk  ] Logging: Initialized pcmk_startup
Sep 21 10:00:23 drbd3.xxx.xxx lrmd: [3102]: info:  
G_main_add_SignalHandler: Added signal handler for signal 17
Sep 21 10:00:23 drbd3.xxx.xxx pengine: [3104]: info: Invoked: /usr/ 
lib64/heartbeat/pengine
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: debug: pid 3100 locked  
in memory.
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: info: Invoked: /usr/lib64/ 
heartbeat/crmd
Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: info: Invoked: /usr/lib64/ 
heartbeat/attrd
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: info:  
G_main_add_TriggerHandler: Added signal manual handler
Sep 21 10:00:23 corosync [pcmk  ] info: pcmk_startup: Maximum core  
file size is: 18446744073709551615
Sep 21 10:00:23 drbd3.xxx.xxx lrmd: [3102]: info: enabling coredumps
Sep 21 10:00:23 drbd3.xxx.xxx pengine: [3104]: debug: main: Checking  
for old instances of pengine
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info:  
crm_cluster_connect: Connecting to OpenAIS
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: info: main: CRM Hg  
Version: 89bd754939df5150de7cd76835f98fe90851b677

Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: info: main: Starting up
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: info:  
G_main_add_SignalHandler: Added signal handler for signal 17
Sep 21 10:00:23 corosync [pcmk  ] debug: pcmk_user_lookup: Cluster  
user hacluster has uid=100 gid=102
Sep 21 10:00:23 drbd3.xxx.xxx lrmd: [3102]: info:  
G_main_add_SignalHandler: Added signal handler for signal 10
Sep 21 10:00:23 drbd3.xxx.xxx pengine: [3104]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
pengine
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info:  
init_ais_connection_once: Creating connection to our AIS plugin
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: info: crmd_init: Starting  
crmd
Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: info:  
crm_cluster_connect: Connecting to OpenAIS
Sep 21 10:00:23 corosync [pcmk  ] info: pcmk_startup: Service: 9
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: info: retrieveCib: Reading  
cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: / 
var/lib/heartbeat/crm/cib.xml.sig)
Sep 21 10:00:23 drbd3.xxx.xxx lrmd: [3102]: info:  
G_main_add_SignalHandler: Added signal handler for signal 12
Sep 21 10:00:23 drbd3.xxx.xxx pengine: [3104]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/pengine
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa:  
Processing I_STARTUP: [ state=S_STARTING cause=C_STARTUP  
origin=crmd_init ]
Sep 21 10:00:23 corosync [pcmk  ] info: pcmk_startup: Local hostname:  
drbd3.xxx.xxx
Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: info:  
init_ais_connection_once: Creating connection to our AIS plugin
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: WARN: retrieveCib: Cluster  
configuration not found: /var/lib/heartbeat/crm/cib.xml
Sep 21 10:00:23 drbd3.xxx.xxx lrmd: [3102]: debug: main: run the loop...
Sep 21 10:00:23 drbd3.xxx.xxx pengine: [3104]: debug: main: Init  
server comms
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_LOG
Sep 21 10:00:23 corosync [pcmk  ] info: pcmk_update_nodeid: Local node  
id: 3556878528
Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: info:  
init_ais_connection_once: Connection to our AIS plugin (9) failed:  
Library error (2)
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: WARN: readCibXmlFile:  
Primary configuration corrupt or unusable, trying backup...
Sep 21 10:00:23 drbd3.xxx.xxx lrmd: [3102]: info: Started.
Sep 21 10:00:23 drbd3.xxx.xxx pengine: [3104]: info: main: Starting  
pengine
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info:  
init_ais_connection_once: AIS connection established
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_STARTUP
Sep 21 10:00:23 corosync [pcmk  ] info: update_member: Creating entry  
for node 3556878528 born on 0
Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: ERROR: main: HA Signon  
failed
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug: do_startup:  
Registering Signal Handlers
Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: info: main: Cluster  
connection active
Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: info: main: Accepting  
attribute updates
Sep 21 10:00:23 corosync [pcmk  ] info: update_member: 0x2aaaac02eef0  
Node 3556878528 now known as drbd3.xxx.xxx (was: (null))
Sep 21 10:00:23 drbd3.xxx.xxx attrd: [3103]: ERROR: main: Aborting  
startup
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: get_last_sequence:  
Series file /var/lib/heartbeat/crm/cib.last does not exist
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info: get_ais_nodeid:  
Server details: id=3556878528 uname=drbd3.xxx.xxx cname=pcmk
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug: do_startup:  
Creating CIB and LRM objects
Sep 21 10:00:23 corosync [pcmk  ] info: update_member: Node  
drbd3.xxx.xxx now has 1 quorum votes (was 0)
Sep 21 10:00:23 corosync [pcmk  ] info: update_member: Node 3556878528/ 
drbd3.xxx.xxx is now: member
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info: crm_new_peer:  
Node drbd3.xxx.xxx now has id: 3556878528
Sep 21 10:00:23 corosync [pcmk  ] info: spawn_child: Forked child 3100  
for process stonithd
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: info:  
G_main_add_SignalHandler: Added signal handler for signal 17
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: readCibXmlFile:  
Backup file /var/lib/heartbeat/crm/cib-99.raw not found
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info: crm_new_peer:  
Node 3556878528 is now known as drbd3.xxx.xxx
Sep 21 10:00:23 corosync [pcmk  ] info: spawn_child: Forked child 3101  
for process cib
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: WARN: readCibXmlFile:  
Continuing with an empty configuration.
Sep 21 10:00:23 corosync [pcmk  ] info: spawn_child: Forked child 3102  
for process lrmd
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: debug: apichan=0xf2c03d0
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk] <cib epoch="0" num_updates="0"  
admin_epoch="0" validate-with="pacemaker-1.0" >
Sep 21 10:00:23 corosync [pcmk  ] info: spawn_child: Forked child 3103  
for process attrd
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: debug:  
callback_chan=0xf2c1ac0
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk]   <configuration >
Sep 21 10:00:23 corosync [pcmk  ] info: spawn_child: Forked child 3104  
for process pengine
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk]     <crm_config />
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: notice: /usr/lib64/ 
heartbeat/stonithd start up successfully.
Sep 21 10:00:23 corosync [pcmk  ] info: spawn_child: Forked child 3105  
for process crmd
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk]     <nodes />
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk]     <resources />
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk]     <constraints />
Sep 21 10:00:23 corosync [SERV  ] Service engine loaded: Pacemaker  
Cluster Manager 1.0.9
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk]   </configuration>
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:23 corosync [SERV  ] Service engine loaded: corosync  
extended virtual synchrony service
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk]   <status />
Sep 21 10:00:23 corosync [SERV  ] Service engine loaded: corosync  
configuration service
Sep 21 10:00:23 drbd3.xxx.xxx stonithd: [3100]: info:  
G_main_add_SignalHandler: Added signal handler for signal 17
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:23 corosync [SERV  ] Service engine loaded: corosync  
cluster closed process group service v1.01
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: log_data_element:  
readCibXmlFile: [on-disk] </cib>
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:23 corosync [SERV  ] Service engine loaded: corosync  
cluster config database access v1.01
Sep 21 10:00:23 corosync [SERV  ] Service engine loaded: corosync  
profile loading service
Sep 21 10:00:23 corosync [SERV  ] Service engine loaded: corosync  
cluster quorum service v0.1
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:23 corosync [MAIN  ] Compatibility mode set to  
whitetank.  Using V1 and V2 of the synchronization engine.
Sep 21 10:00:23 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:23 corosync [TOTEM ] entering GATHER state from 15.
Sep 21 10:00:23 corosync [TOTEM ] Creating commit token because I am  
the rep.
Sep 21 10:00:23 corosync [TOTEM ] Saving state aru 0 high seq received 0
Sep 21 10:00:23 corosync [TOTEM ] Storing new sequence id for ring 8
Sep 21 10:00:23 corosync [TOTEM ] entering COMMIT state.
Sep 21 10:00:23 corosync [TOTEM ] got commit token
Sep 21 10:00:23 corosync [TOTEM ] entering RECOVERY state.
Sep 21 10:00:23 corosync [TOTEM ] position [0] member 192.168.1.212:
Sep 21 10:00:23 corosync [TOTEM ] previous ring seq 4 rep 192.168.1.212
Sep 21 10:00:23 corosync [TOTEM ] aru 0 high delivered 0 received flag 1
Sep 21 10:00:23 corosync [TOTEM ] Did not need to originate any  
messages in recovery.
Sep 21 10:00:23 corosync [TOTEM ] got commit token
Sep 21 10:00:23 corosync [TOTEM ] Sending initial ORF token
Sep 21 10:00:23 corosync [TOTEM ] token retrans flag is 0 my set  
retrans flag0 retrans queue empty 1 count 0, aru 0
Sep 21 10:00:23 corosync [TOTEM ] install seq 0 aru 0 high seq  
received 0
Sep 21 10:00:23 corosync [TOTEM ] token retrans flag is 0 my set  
retrans flag0 retrans queue empty 1 count 1, aru 0
Sep 21 10:00:23 corosync [TOTEM ] install seq 0 aru 0 high seq  
received 0
Sep 21 10:00:23 corosync [TOTEM ] token retrans flag is 0 my set  
retrans flag0 retrans queue empty 1 count 2, aru 0
Sep 21 10:00:23 corosync [TOTEM ] install seq 0 aru 0 high seq  
received 0
Sep 21 10:00:23 corosync [TOTEM ] token retrans flag is 0 my set  
retrans flag0 retrans queue empty 1 count 3, aru 0
Sep 21 10:00:23 corosync [TOTEM ] install seq 0 aru 0 high seq  
received 0
Sep 21 10:00:23 corosync [TOTEM ] retrans flag count 4 token aru 0  
install seq 0 aru 0 0
Sep 21 10:00:23 corosync [TOTEM ] Resetting old ring state
Sep 21 10:00:23 corosync [TOTEM ] recovery to regular 1-0
Sep 21 10:00:23 corosync [TOTEM ] Delivering to app 1 to 0
Sep 21 10:00:23 corosync [pcmk  ] notice: pcmk_peer_update:  
Transitional membership event on ring 8: memb=0, new=0, lost=0
Sep 21 10:00:23 corosync [pcmk  ] notice: pcmk_peer_update: Stable  
membership event on ring 8: memb=1, new=1, lost=0
Sep 21 10:00:23 corosync [pcmk  ] info: pcmk_peer_update: NEW:   
drbd3.xxx.xxx 3556878528
Sep 21 10:00:23 corosync [pcmk  ] debug: pcmk_peer_update: Node  
3556878528 has address r(0) ip(192.168.1.212)
Sep 21 10:00:23 corosync [pcmk  ] info: pcmk_peer_update: MEMB:  
drbd3.xxx.xxx 3556878528
Sep 21 10:00:23 corosync [pcmk  ] debug: send_cluster_id: Local  
update: id=3556878528, born=0, seq=8
Sep 21 10:00:23 corosync [pcmk  ] info: update_member: Node  
drbd3.xxx.xxx now has process list: 00000000000000000000000000013312  
(78610)
Sep 21 10:00:23 corosync [SYNC  ] This node is within the primary  
component and will provide service.
Sep 21 10:00:23 corosync [TOTEM ] entering OPERATIONAL state.
Sep 21 10:00:23 corosync [TOTEM ] A processor joined or left the  
membership and a new membership was formed.
Sep 21 10:00:23 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:23 corosync [TOTEM ] Delivering 0 to 1
Sep 21 10:00:23 corosync [TOTEM ] Delivering MCAST message with seq 1  
to pending delivery queue
Sep 21 10:00:23 corosync [pcmk  ] debug: pcmk_cluster_id_callback:  
Node update: drbd3.xxx.xxx (1.0.9)
Sep 21 10:00:23 corosync [SYNC  ] confchg entries 1
Sep 21 10:00:23 corosync [SYNC  ] Barrier Start Received From -738088768
Sep 21 10:00:23 corosync [SYNC  ] Barrier completion status for nodeid  
-738088768 = 1.
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: debug: activateCibXml:  
Triggering CIB write for start op
Sep 21 10:00:23 corosync [SYNC  ] Synchronization barrier completed
Sep 21 10:00:23 corosync [SYNC  ] Synchronization actions starting for  
(dummy CLM service)
Sep 21 10:00:23 drbd3.xxx.xxx cib: [3101]: info: startCib: CIB  
Initialization completed successfully
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 drbd3.xxx.xxx cib: [3101]: info: crm_cluster_connect:  
Connecting to OpenAIS
Sep 21 10:00:24 corosync [TOTEM ] Delivering 1 to 2
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq 2  
to pending delivery queue
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 drbd3.xxx.xxx cib: [3101]: info:  
init_ais_connection_once: Creating connection to our AIS plugin
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including 1
Sep 21 10:00:24 corosync [TOTEM ] Delivering 2 to 3
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq 3  
to pending delivery queue
Sep 21 10:00:24 corosync [SYNC  ] confchg entries 1
Sep 21 10:00:24 corosync [SYNC  ] Barrier Start Received From -738088768
Sep 21 10:00:24 drbd3.xxx.xxx cib: [3101]: info:  
init_ais_connection_once: Connection to our AIS plugin (9) failed:  
Library error (2)
Sep 21 10:00:24 corosync [SYNC  ] Barrier completion status for nodeid  
-738088768 = 1.
Sep 21 10:00:24 corosync [SYNC  ] Synchronization barrier completed
Sep 21 10:00:24 drbd3.xxx.xxx cib: [3101]: CRIT: cib_init: Cannot sign  
in to the cluster... terminating
Sep 21 10:00:24 corosync [SYNC  ] Committing synchronization for  
(dummy CLM service)
Sep 21 10:00:24 corosync [SYNC  ] Synchronization actions starting for  
(dummy AMF service)
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including 2
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including 3
Sep 21 10:00:24 corosync [TOTEM ] Delivering 3 to 4
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq 4  
to pending delivery queue
Sep 21 10:00:24 corosync [SYNC  ] confchg entries 1
Sep 21 10:00:24 corosync [SYNC  ] Barrier Start Received From -738088768
Sep 21 10:00:24 corosync [SYNC  ] Barrier completion status for nodeid  
-738088768 = 1.
Sep 21 10:00:24 corosync [SYNC  ] Synchronization barrier completed
Sep 21 10:00:24 corosync [SYNC  ] Committing synchronization for  
(dummy AMF service)
Sep 21 10:00:24 corosync [SYNC  ] Synchronization actions starting for  
(dummy CKPT service)
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including 4
Sep 21 10:00:24 corosync [TOTEM ] Delivering 4 to 5
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq 5  
to pending delivery queue
Sep 21 10:00:24 corosync [SYNC  ] confchg entries 1
Sep 21 10:00:24 corosync [SYNC  ] Barrier Start Received From -738088768
Sep 21 10:00:24 corosync [SYNC  ] Barrier completion status for nodeid  
-738088768 = 1.
Sep 21 10:00:24 corosync [SYNC  ] Synchronization barrier completed
Sep 21 10:00:24 corosync [SYNC  ] Committing synchronization for  
(dummy CKPT service)
Sep 21 10:00:24 corosync [SYNC  ] Synchronization actions starting for  
(dummy EVT service)
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] Delivering 5 to 6
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq 6  
to pending delivery queue
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including 5
Sep 21 10:00:24 corosync [TOTEM ] Delivering 6 to 7
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq 7  
to pending delivery queue
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including 6
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including 7
Sep 21 10:00:24 corosync [TOTEM ] Delivering 7 to 8
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq 8  
to pending delivery queue
Sep 21 10:00:24 corosync [SYNC  ] confchg entries 1
Sep 21 10:00:24 corosync [SYNC  ] Barrier Start Received From -738088768
Sep 21 10:00:24 corosync [SYNC  ] Barrier completion status for nodeid  
-738088768 = 1.
Sep 21 10:00:24 corosync [SYNC  ] Synchronization barrier completed
Sep 21 10:00:24 corosync [SYNC  ] Committing synchronization for  
(dummy EVT service)
Sep 21 10:00:24 corosync [SYNC  ] Synchronization actions starting for  
(corosync cluster closed process group service v1.01)
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] Delivering 8 to a
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq 9  
to pending delivery queue
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq a  
to pending delivery queue
Sep 21 10:00:24 corosync [CPG   ] downlist left_list: 0
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including 8
Sep 21 10:00:24 corosync [TOTEM ] Delivering a to b
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq b  
to pending delivery queue
Sep 21 10:00:24 corosync [SYNC  ] confchg entries 1
Sep 21 10:00:24 corosync [SYNC  ] Barrier Start Received From -738088768
Sep 21 10:00:24 corosync [SYNC  ] Barrier completion status for nodeid  
-738088768 = 1.
Sep 21 10:00:24 corosync [SYNC  ] Synchronization barrier completed
Sep 21 10:00:24 corosync [SYNC  ] Committing synchronization for  
(corosync cluster closed process group service v1.01)
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including a
Sep 21 10:00:24 corosync [TOTEM ] Delivering b to c
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq c  
to pending delivery queue
Sep 21 10:00:24 corosync [MAIN  ] Completed service synchronization,  
ready to provide service.
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including b
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including c
Sep 21 10:00:24 corosync [pcmk  ] info: pcmk_ipc: Recorded connection  
0x2aaaac03a1a0 for stonithd/3100
Sep 21 10:00:24 corosync [pcmk  ] debug: process_ais_message: Msg[0]  
(dest=local:ais, from=drbd3.xxx.xxx:stonithd.3100, remote=true,  
size=5): 3100
Sep 21 10:00:24 corosync [pcmk  ] ERROR: pcmk_wait_dispatch: Child  
process cib exited (pid=3101, rc=100)
Sep 21 10:00:24 corosync [pcmk  ] notice: pcmk_wait_dispatch: Child  
process cib no longer wishes to be respawned
Sep 21 10:00:24 corosync [pcmk  ] debug: send_cluster_id: Local  
update: id=3556878528, born=0, seq=8
Sep 21 10:00:24 corosync [pcmk  ] info: update_member: Node  
drbd3.xxx.xxx now has process list: 00000000000000000000000000013212  
(78354)
Sep 21 10:00:24 corosync [pcmk  ] ERROR: pcmk_wait_dispatch: Child  
process attrd exited (pid=3103, rc=100)
Sep 21 10:00:24 corosync [pcmk  ] notice: pcmk_wait_dispatch: Child  
process attrd no longer wishes to be respawned
Sep 21 10:00:24 corosync [pcmk  ] debug: send_cluster_id: Local  
update: id=3556878528, born=0, seq=8
Sep 21 10:00:24 corosync [pcmk  ] info: update_member: Node  
drbd3.xxx.xxx now has process list: 00000000000000000000000000012212  
(74258)
Sep 21 10:00:24 corosync [TOTEM ] mcasted message added to pending queue
Sep 21 10:00:24 corosync [TOTEM ] Delivering c to d
Sep 21 10:00:24 corosync [TOTEM ] Delivering MCAST message with seq d  
to pending delivery queue
Sep 21 10:00:24 corosync [pcmk  ] debug: pcmk_cluster_id_callback:  
Node update: drbd3.xxx.xxx (1.0.9)
Sep 21 10:00:24 corosync [pcmk  ] info: update_member: Node  
drbd3.xxx.xxx now has process list: 00000000000000000000000000013212  
(78354)
Sep 21 10:00:24 corosync [pcmk  ] info: update_member: Node  
drbd3.xxx.xxx now has process list: 00000000000000000000000000012212  
(74258)
Sep 21 10:00:24 corosync [pcmk  ] info: send_member_notification:  
Sending membership update 8 to 0 children
Sep 21 10:00:24 corosync [pcmk  ] debug: pcmk_cluster_id_callback:  
Node update: drbd3.xxx.xxx (1.0.9)
Sep 21 10:00:24 corosync [TOTEM ] releasing messages up to and  
including d
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 1 times... pause and retry
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=5
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:24 drbd3.xxx.xxx crmd: [3105]: info: crmd_init: Starting  
crmd's mainloop
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:26 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 2 times... pause and retry
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=6
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:27 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:29 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 3 times... pause and retry
Sep 21 10:00:30 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=7
Sep 21 10:00:31 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:31 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:32 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:32 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:32 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:33 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:33 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:33 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:33 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:33 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:33 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:33 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 4 times... pause and retry
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=8
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:34 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:36 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 5 times... pause and retry
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=9
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:37 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:39 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 6 times... pause and retry
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=10
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:40 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:42 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 7 times... pause and retry
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=11
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:43 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:45 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 8 times... pause and retry
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=12
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:46 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:48 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 9 times... pause and retry
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=13
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:49 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:51 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 10 times... pause and retry
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=14
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:52 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:54 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 11 times... pause and retry
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=15
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:55 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:57 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 12 times... pause and retry
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=16
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:00:58 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:01:00 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 13 times... pause and retry
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=17
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:01:01 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:01:03 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 14 times... pause and retry
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=18
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:01:04 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:01:06 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 15 times... pause and retry
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=19
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:01:07 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: info: crm_timer_popped:  
Wait Timer (I_NULL) just popped!
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug: do_fsa_action:  
actions:trace: 	// A_CIB_START
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:01:09 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_rw
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_rw
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to command channel failed
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/ 
cib_callback
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug:  
init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/ 
crm/cib_callback
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to callback channel failed
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug:  
cib_native_signon_raw: Connection to CIB failed: connection failed
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug: cib_native_signoff:  
Signing out of the CIB Service
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: info: do_cib_control:  
Could not connect to the CIB service: connection failed
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: WARN: do_cib_control:  
Couldn't complete CIB registration 16 times... pause and retry
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug: crm_timer_start:  
Started Wait Timer (I_NULL:2000ms), src=20
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug:  
register_fsa_input_adv: Stalling the FSA pending further input:  
cause=C_FSA_INTERNAL
Sep 21 10:01:10 drbd3.xxx.xxx crmd: [3105]: debug: s_crmd_fsa: Exiting  
the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true







More information about the Pacemaker mailing list