Oct 15 15:15:47 vm3 corosync[8183]:   [MAIN  ] main.c:main:1171 Corosync Cluster Engine ('2.3.2.4-805b3'): started and ready to provide service.
Oct 15 15:15:47 vm3 corosync[8183]:   [MAIN  ] main.c:main:1172 Corosync built-in features: watchdog upstart snmp pie relro bindnow
Oct 15 15:15:48 vm3 corosync[8184]:   [TOTEM ] totemnet.c:totemnet_instance_initialize:242 Initializing transport (UDP/IP Multicast).
Oct 15 15:15:48 vm3 corosync[8184]:   [TOTEM ] totemcrypto.c:init_nss:579 Initializing transmit/receive security (NSS) crypto: aes256 hash: sha1
Oct 15 15:15:48 vm3 corosync[8184]:   [TOTEM ] totemnet.c:totemnet_instance_initialize:242 Initializing transport (UDP/IP Multicast).
Oct 15 15:15:48 vm3 corosync[8184]:   [TOTEM ] totemcrypto.c:init_nss:579 Initializing transmit/receive security (NSS) crypto: aes256 hash: sha1
Oct 15 15:15:48 vm3 corosync[8184]:   [TOTEM ] totemudp.c:timer_function_netif_check_timeout:670 The network interface [192.168.101.143] is now up.
Oct 15 15:15:48 vm3 corosync[8184]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync configuration map access [0]
Oct 15 15:15:48 vm3 corosync[8184]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: cmap
Oct 15 15:15:48 vm3 corosync[8184]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync configuration service [1]
Oct 15 15:15:48 vm3 corosync[8184]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: cfg
Oct 15 15:15:48 vm3 corosync[8184]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync cluster closed process group service v1.01 [2]
Oct 15 15:15:48 vm3 corosync[8184]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: cpg
Oct 15 15:15:48 vm3 corosync[8184]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync profile loading service [4]
Oct 15 15:15:48 vm3 corosync[8184]:   [WD    ] wd.c:setup_watchdog:651 Watchdog is now been tickled by corosync.
Oct 15 15:15:48 vm3 corosync[8184]:   [WD    ] wd.c:wd_scan_resources:580 no resources configured.
Oct 15 15:15:48 vm3 corosync[8184]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync watchdog service [7]
Oct 15 15:15:48 vm3 corosync[8184]:   [QUORUM] vsf_quorum.c:quorum_exec_init_fn:274 Using quorum provider corosync_votequorum
Oct 15 15:15:48 vm3 corosync[8184]:   [VOTEQ ] votequorum.c:are_we_quorate:744 Waiting for all cluster members. Current votes: 1 expected_votes: 2
Oct 15 15:15:48 vm3 corosync[8184]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync vote quorum service v1.0 [5]
Oct 15 15:15:48 vm3 corosync[8184]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: votequorum
Oct 15 15:15:48 vm3 corosync[8184]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync cluster quorum service v0.1 [3]
Oct 15 15:15:48 vm3 corosync[8184]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: quorum
Oct 15 15:15:48 vm3 corosync[8184]:   [TOTEM ] totemudp.c:timer_function_netif_check_timeout:670 The network interface [192.168.102.143] is now up.
Oct 15 15:15:48 vm3 corosync[8184]:   [TOTEM ] totemsrp.c:memb_state_operational_enter:1966 A new membership (192.168.101.143:4) was formed. Members joined: -1062705777
Oct 15 15:15:48 vm3 corosync[8184]:   [VOTEQ ] votequorum.c:are_we_quorate:744 Waiting for all cluster members. Current votes: 1 expected_votes: 2
Oct 15 15:15:48 vm3 corosync[8184]:   [VOTEQ ] votequorum.c:are_we_quorate:744 Waiting for all cluster members. Current votes: 1 expected_votes: 2
Oct 15 15:15:48 vm3 corosync[8184]:   [VOTEQ ] votequorum.c:are_we_quorate:744 Waiting for all cluster members. Current votes: 1 expected_votes: 2
Oct 15 15:15:48 vm3 corosync[8184]:   [QUORUM] vsf_quorum.c:log_view_list:132 Members[1]: -1062705777
Oct 15 15:15:48 vm3 corosync[8184]:   [MAIN  ] main.c:corosync_sync_completed:276 Completed service synchronization, ready to provide service.
Oct 15 15:15:49 vm3 corosync[8184]:   [TOTEM ] totemsrp.c:memb_state_operational_enter:1966 A new membership (192.168.101.141:12) was formed. Members joined: -1062705779 -1062705778
Oct 15 15:15:49 vm3 corosync[8184]:   [QUORUM] vsf_quorum.c:quorum_api_set_quorum:148 This node is within the primary component and will provide service.
Oct 15 15:15:49 vm3 corosync[8184]:   [QUORUM] vsf_quorum.c:log_view_list:132 Members[3]: -1062705779 -1062705778 -1062705777
Oct 15 15:15:49 vm3 corosync[8184]:   [MAIN  ] main.c:corosync_sync_completed:276 Completed service synchronization, ready to provide service.
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 15 15:15:50 vm3 pacemakerd[8193]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_ipc_connect: Could not establish pacemakerd connection: Connection refused (111)
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: get_cluster_type: Detected an active 'corosync' cluster
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: mcp_read_config: Reading configure for stack: corosync
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: mcp_read_config: Configured corosync to accept connections from group 492: OK (1)
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: main: Starting Pacemaker 1.1.11-0.284.6a5e863.git.el6 (Build: 6a5e863):  generated-manpages agent-manpages ascii-docs ncurses libqb-logging libqb-ipc lha-fencing nagios  corosync-native snmp
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: main: Maximum core file size is: 18446744073709551615
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: qb_ipcs_us_publish: server name: pacemakerd
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Created entry bcf2200d-fdca-48b9-83e1-fe9c134e2b9f/0x9c8140 for node (null)/3232261519 (1 total)
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Node 3232261519 has uuid 3232261519
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261519] - corosync-cpg is now online
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: cluster_connect_quorum: Quorum acquired
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Node 3232261519 is now known as vm3
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Using uid=496 and group=492 for process cib
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Forked child 8197 for process cib
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Forked child 8198 for process stonith-ng
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Forked child 8199 for process lrmd
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Using uid=496 and group=492 for process attrd
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Forked child 8200 for process attrd
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Using uid=496 and group=492 for process pengine
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Forked child 8201 for process pengine
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Using uid=496 and group=492 for process crmd
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: start_child: Forked child 8202 for process crmd
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: main: Starting mainloop
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: pcmk_quorum_notification: Membership 12: quorum retained (3)
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Created entry b8ff1402-01ed-4932-b7fe-2402327df2bd/0xaca3d0 for node (null)/3232261517 (2 total)
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Node 3232261517 has uuid 3232261517
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: pcmk_quorum_notification: Obtaining name for new node 3232261517
Oct 15 15:15:50 vm3 cib[8197]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 15 15:15:50 vm3 cib[8197]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Oct 15 15:15:50 vm3 cib[8197]:   notice: main: Using new config location: /var/lib/pacemaker/cib
Oct 15 15:15:50 vm3 cib[8197]:     info: get_cluster_type: Verifying cluster type: 'corosync'
Oct 15 15:15:50 vm3 cib[8197]:     info: get_cluster_type: Assuming an active 'corosync' cluster
Oct 15 15:15:50 vm3 cib[8197]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.xml (digest: /var/lib/pacemaker/cib/cib.xml.sig)
Oct 15 15:15:50 vm3 cib[8197]:  warning: retrieveCib: Cluster configuration not found: /var/lib/pacemaker/cib/cib.xml
Oct 15 15:15:50 vm3 cib[8197]:  warning: readCibXmlFile: Primary configuration corrupt or unusable, trying backups in /var/lib/pacemaker/cib
Oct 15 15:15:50 vm3 cib[8197]:  warning: readCibXmlFile: Continuing with an empty configuration.
Oct 15 15:15:50 vm3 cib[8197]:     info: validate_with_relaxng: Creating RNG parser context
Oct 15 15:15:50 vm3 lrmd[8199]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 15 15:15:50 vm3 pengine[8201]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 15 15:15:50 vm3 lrmd[8199]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 15 15:15:50 vm3 stonith-ng[8198]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 15 15:15:50 vm3 stonith-ng[8198]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 15 15:15:50 vm3 pengine[8201]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: get_cluster_type: Verifying cluster type: 'corosync'
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: get_cluster_type: Assuming an active 'corosync' cluster
Oct 15 15:15:50 vm3 pengine[8201]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Oct 15 15:15:50 vm3 lrmd[8199]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261517
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node (null)[3232261517] - state is now member (was (null))
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Created entry b4f60683-9fb1-4bbe-9c0a-112a871db96c/0xac9630 for node (null)/3232261518 (3 total)
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Node 3232261518 has uuid 3232261518
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: pcmk_quorum_notification: Obtaining name for new node 3232261518
Oct 15 15:15:50 vm3 pengine[8201]:     info: qb_ipcs_us_publish: server name: pengine
Oct 15 15:15:50 vm3 lrmd[8199]:     info: qb_ipcs_us_publish: server name: lrmd
Oct 15 15:15:50 vm3 lrmd[8199]:     info: main: Starting
Oct 15 15:15:50 vm3 attrd[8200]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 15 15:15:50 vm3 attrd[8200]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 15 15:15:50 vm3 pengine[8201]:     info: main: Starting pengine
Oct 15 15:15:50 vm3 crmd[8202]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 15 15:15:50 vm3 crmd[8202]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 15 15:15:50 vm3 crmd[8202]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Oct 15 15:15:50 vm3 stonith-ng[8198]:   notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
Oct 15 15:15:50 vm3 crmd[8202]:   notice: main: CRM Git Version: 6a5e863
Oct 15 15:15:50 vm3 crmd[8202]:     info: do_log: FSA: Input I_STARTUP from crmd_init() received in state S_STARTING
Oct 15 15:15:50 vm3 crmd[8202]:     info: get_cluster_type: Verifying cluster type: 'corosync'
Oct 15 15:15:50 vm3 crmd[8202]:     info: get_cluster_type: Assuming an active 'corosync' cluster
Oct 15 15:15:50 vm3 crmd[8202]:     info: crm_ipc_connect: Could not establish cib_shm connection: Connection refused (111)
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Oct 15 15:15:50 vm3 attrd[8200]:     info: main: Starting up
Oct 15 15:15:50 vm3 attrd[8200]:     info: get_cluster_type: Verifying cluster type: 'corosync'
Oct 15 15:15:50 vm3 attrd[8200]:     info: get_cluster_type: Assuming an active 'corosync' cluster
Oct 15 15:15:50 vm3 attrd[8200]:   notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
Oct 15 15:15:50 vm3 cib[8197]:     info: startCib: CIB Initialization completed successfully
Oct 15 15:15:50 vm3 cib[8197]:   notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261518
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node (null)[3232261518] - state is now member (was (null))
Oct 15 15:15:50 vm3 pacemakerd[8193]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node vm3[3232261519] - state is now member (was (null))
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Node 3232261517 is now known as vm1
Oct 15 15:15:50 vm3 pacemakerd[8193]:     info: crm_get_peer: Node 3232261518 is now known as vm2
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: crm_get_peer: Created entry 8208e0f8-1151-40f5-bfa4-037f892d498b/0x1da3660 for node (null)/3232261519 (1 total)
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: crm_get_peer: Node 3232261519 has uuid 3232261519
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261519] - corosync-cpg is now online
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: init_cs_connection_once: Connection to 'corosync': established
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_get_peer: Created entry e3bc84ac-377b-4922-a7c0-855520389256/0x89a120 for node (null)/3232261519 (1 total)
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_get_peer: Created entry 97f4b296-0a4a-4020-8f07-288263dfa9cf/0x105e0b0 for node (null)/3232261519 (1 total)
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_get_peer: Node 3232261519 has uuid 3232261519
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261519] - corosync-cpg is now online
Oct 15 15:15:50 vm3 cib[8197]:     info: init_cs_connection_once: Connection to 'corosync': established
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_get_peer: Node 3232261519 has uuid 3232261519
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261519] - corosync-cpg is now online
Oct 15 15:15:50 vm3 attrd[8200]:   notice: crm_update_peer_state: attrd_peer_change_cb: Node (null)[3232261519] - state is now member (was (null))
Oct 15 15:15:50 vm3 stonith-ng[8198]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:15:50 vm3 stonith-ng[8198]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: crm_get_peer: Node 3232261519 is now known as vm3
Oct 15 15:15:50 vm3 stonith-ng[8198]:     info: crm_ipc_connect: Could not establish cib_rw connection: Connection refused (111)
Oct 15 15:15:50 vm3 attrd[8200]:     info: init_cs_connection_once: Connection to 'corosync': established
Oct 15 15:15:50 vm3 cib[8197]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:15:50 vm3 cib[8197]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_get_peer: Node 3232261519 is now known as vm3
Oct 15 15:15:50 vm3 cib[8197]:     info: qb_ipcs_us_publish: server name: cib_ro
Oct 15 15:15:50 vm3 cib[8197]:     info: qb_ipcs_us_publish: server name: cib_rw
Oct 15 15:15:50 vm3 cib[8197]:     info: qb_ipcs_us_publish: server name: cib_shm
Oct 15 15:15:50 vm3 cib[8197]:     info: cib_init: Starting cib mainloop
Oct 15 15:15:50 vm3 cib[8203]:     info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 3930c46445d2289a49a22e68ead11aaf)
Oct 15 15:15:50 vm3 attrd[8200]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:15:50 vm3 attrd[8200]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_get_peer: Node 3232261519 is now known as vm3
Oct 15 15:15:50 vm3 attrd[8200]:     info: main: Cluster connection active
Oct 15 15:15:50 vm3 attrd[8200]:     info: qb_ipcs_us_publish: server name: attrd
Oct 15 15:15:50 vm3 attrd[8200]:     info: main: Accepting attribute updates
Oct 15 15:15:50 vm3 cib[8197]:     info: pcmk_cpg_membership: Joined[0.0] cib.3232261519 
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_get_peer: Created entry 8947b562-65b8-4025-a01a-e30a3731ae97/0x1060940 for node (null)/3232261517 (2 total)
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_get_peer: Node 3232261517 has uuid 3232261517
Oct 15 15:15:50 vm3 cib[8197]:     info: pcmk_cpg_membership: Member[0.0] cib.3232261517 
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261517] - corosync-cpg is now online
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_get_peer: Created entry 430af7bb-5cea-4d11-b487-a6fbd6117420/0x105fe70 for node (null)/3232261518 (3 total)
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_get_peer: Node 3232261518 has uuid 3232261518
Oct 15 15:15:50 vm3 cib[8197]:     info: pcmk_cpg_membership: Member[0.1] cib.3232261518 
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261518] - corosync-cpg is now online
Oct 15 15:15:50 vm3 cib[8197]:     info: pcmk_cpg_membership: Member[0.2] cib.3232261519 
Oct 15 15:15:50 vm3 cib[8197]:     info: crm_client_new: Connecting 0x10609b0 for uid=496 gid=492 pid=8200 id=f0931696-f31d-4e43-a7b0-709a6c8cc0f1
Oct 15 15:15:50 vm3 cib[8203]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.BUXiWE (digest: /var/lib/pacemaker/cib/cib.OHt8yb)
Oct 15 15:15:50 vm3 attrd[8200]:     info: attrd_cib_connect: Connected to the CIB after 1 attempts
Oct 15 15:15:50 vm3 attrd[8200]:     info: main: CIB connection active
Oct 15 15:15:50 vm3 attrd[8200]:     info: pcmk_cpg_membership: Joined[0.0] attrd.3232261519 
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_get_peer: Created entry 892ac7d7-32e9-451a-8559-ed2820cc1938/0x99f8e0 for node (null)/3232261517 (2 total)
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_get_peer: Node 3232261517 has uuid 3232261517
Oct 15 15:15:50 vm3 attrd[8200]:     info: pcmk_cpg_membership: Member[0.0] attrd.3232261517 
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261517] - corosync-cpg is now online
Oct 15 15:15:50 vm3 attrd[8200]:   notice: crm_update_peer_state: attrd_peer_change_cb: Node (null)[3232261517] - state is now member (was (null))
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_get_peer: Created entry 4bfc2a0d-67d0-4169-8296-d44a0d5171f2/0x99f750 for node (null)/3232261518 (3 total)
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_get_peer: Node 3232261518 has uuid 3232261518
Oct 15 15:15:50 vm3 attrd[8200]:     info: pcmk_cpg_membership: Member[0.1] attrd.3232261518 
Oct 15 15:15:50 vm3 attrd[8200]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261518] - corosync-cpg is now online
Oct 15 15:15:50 vm3 attrd[8200]:   notice: crm_update_peer_state: attrd_peer_change_cb: Node (null)[3232261518] - state is now member (was (null))
Oct 15 15:15:50 vm3 attrd[8200]:     info: pcmk_cpg_membership: Member[0.2] attrd.3232261519 
Oct 15 15:15:51 vm3 cib[8197]:     info: crm_client_new: Connecting 0x10e1c10 for uid=496 gid=492 pid=8202 id=fa7e699d-079c-4853-96a7-b6144800f795
Oct 15 15:15:51 vm3 crmd[8202]:     info: do_cib_control: CIB connection established
Oct 15 15:15:51 vm3 crmd[8202]:   notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
Oct 15 15:15:51 vm3 cib[8197]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/2, version=0.0.0)
Oct 15 15:15:51 vm3 crmd[8202]:     info: crm_get_peer: Created entry 595fd501-d6db-4179-a853-a85a4d02e3b2/0x2499ed0 for node (null)/3232261519 (1 total)
Oct 15 15:15:51 vm3 crmd[8202]:     info: crm_get_peer: Node 3232261519 has uuid 3232261519
Oct 15 15:15:51 vm3 crmd[8202]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261519] - corosync-cpg is now online
Oct 15 15:15:51 vm3 crmd[8202]:     info: init_cs_connection_once: Connection to 'corosync': established
Oct 15 15:15:51 vm3 crmd[8202]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:15:51 vm3 crmd[8202]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:15:51 vm3 crmd[8202]:     info: crm_get_peer: Node 3232261519 is now known as vm3
Oct 15 15:15:51 vm3 crmd[8202]:     info: peer_update_callback: vm3 is now (null)
Oct 15 15:15:51 vm3 crmd[8202]:   notice: cluster_connect_quorum: Quorum acquired
Oct 15 15:15:51 vm3 cib[8197]:     info: crm_client_new: Connecting 0x10e2440 for uid=0 gid=0 pid=8198 id=567e70bd-77bd-4772-be7b-8d8e33a96898
Oct 15 15:15:51 vm3 stonith-ng[8198]:   notice: setup_cib: Watching for stonith topology changes
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: qb_ipcs_us_publish: server name: stonith-ng
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: main: Starting stonith-ng mainloop
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: pcmk_cpg_membership: Joined[0.0] stonith-ng.3232261519 
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: crm_get_peer: Created entry ecdaf312-bd1d-4f48-a1d7-f0933b259ecb/0x1da7690 for node (null)/3232261517 (2 total)
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: crm_get_peer: Node 3232261517 has uuid 3232261517
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: pcmk_cpg_membership: Member[0.0] stonith-ng.3232261517 
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261517] - corosync-cpg is now online
Oct 15 15:15:51 vm3 cib[8197]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/2, version=0.0.0)
Oct 15 15:15:51 vm3 crmd[8202]:     info: do_ha_control: Connected to the cluster
Oct 15 15:15:51 vm3 crmd[8202]:     info: lrmd_ipc_connect: Connecting to lrmd
Oct 15 15:15:51 vm3 cib[8197]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/3, version=0.0.0)
Oct 15 15:15:51 vm3 lrmd[8199]:     info: crm_client_new: Connecting 0x1899d10 for uid=496 gid=492 pid=8202 id=1243f0c7-71da-42ce-9674-1d0f812aa239
Oct 15 15:15:51 vm3 crmd[8202]:     info: do_lrm_control: LRM connection established
Oct 15 15:15:51 vm3 crmd[8202]:     info: do_started: Delaying start, no membership data (0000000000100000)
Oct 15 15:15:51 vm3 cib[8197]:     info: cib_process_request: Completed cib_query operation for section crm_config: OK (rc=0, origin=local/crmd/4, version=0.0.0)
Oct 15 15:15:51 vm3 crmd[8202]:     info: pcmk_quorum_notification: Membership 12: quorum retained (3)
Oct 15 15:15:51 vm3 crmd[8202]:     info: crm_get_peer: Created entry 1e93e317-538b-46f0-ab35-f0f2851aee42/0x25e0eb0 for node (null)/3232261517 (2 total)
Oct 15 15:15:51 vm3 crmd[8202]:     info: crm_get_peer: Node 3232261517 has uuid 3232261517
Oct 15 15:15:51 vm3 crmd[8202]:     info: pcmk_quorum_notification: Obtaining name for new node 3232261517
Oct 15 15:15:51 vm3 stonith-ng[8198]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:15:51 vm3 stonith-ng[8198]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: crm_get_peer: Created entry 4c86827f-c5b5-45e9-85b2-eb2987f6bdc7/0x1da71a0 for node (null)/3232261518 (3 total)
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: crm_get_peer: Node 3232261518 has uuid 3232261518
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: pcmk_cpg_membership: Member[0.1] stonith-ng.3232261518 
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261518] - corosync-cpg is now online
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: pcmk_cpg_membership: Member[0.2] stonith-ng.3232261519 
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: crm_get_peer: Node 3232261518 is now known as vm2
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: init_cib_cache_cb: Updating device list from the cib: init
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: unpack_nodes: Creating a fake local node
Oct 15 15:15:51 vm3 crmd[8202]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261517
Oct 15 15:15:51 vm3 crmd[8202]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node (null)[3232261517] - state is now member (was (null))
Oct 15 15:15:51 vm3 crmd[8202]:     info: crm_get_peer: Created entry 2eeb86a4-65c5-407f-8a3c-a9f054da33a9/0x25dd7f0 for node (null)/3232261518 (3 total)
Oct 15 15:15:51 vm3 crmd[8202]:     info: crm_get_peer: Node 3232261518 has uuid 3232261518
Oct 15 15:15:51 vm3 crmd[8202]:     info: pcmk_quorum_notification: Obtaining name for new node 3232261518
Oct 15 15:15:51 vm3 crmd[8202]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261518
Oct 15 15:15:51 vm3 crmd[8202]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node (null)[3232261518] - state is now member (was (null))
Oct 15 15:15:51 vm3 crmd[8202]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node vm3[3232261519] - state is now member (was (null))
Oct 15 15:15:51 vm3 crmd[8202]:     info: peer_update_callback: vm3 is now member (was (null))
Oct 15 15:15:51 vm3 stonith-ng[8198]:     info: crm_get_peer: Node 3232261517 is now known as vm1
Oct 15 15:15:51 vm3 crmd[8202]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:15:51 vm3 crmd[8202]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:15:51 vm3 crmd[8202]:     info: qb_ipcs_us_publish: server name: crmd
Oct 15 15:15:51 vm3 crmd[8202]:   notice: do_started: The local CRM is operational
Oct 15 15:15:51 vm3 crmd[8202]:     info: do_log: FSA: Input I_PENDING from do_started() received in state S_STARTING
Oct 15 15:15:51 vm3 crmd[8202]:   notice: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Oct 15 15:15:51 vm3 cib[8197]:     info: cib_process_request: Completed cib_slave operation for section 'all': OK (rc=0, origin=local/crmd/5, version=0.0.0)
Oct 15 15:15:52 vm3 crmd[8202]:     info: pcmk_cpg_membership: Joined[0.0] crmd.3232261519 
Oct 15 15:15:52 vm3 crmd[8202]:     info: pcmk_cpg_membership: Member[0.0] crmd.3232261517 
Oct 15 15:15:52 vm3 crmd[8202]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261517] - corosync-cpg is now online
Oct 15 15:15:52 vm3 crmd[8202]:     info: pcmk_cpg_membership: Member[0.1] crmd.3232261518 
Oct 15 15:15:52 vm3 crmd[8202]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261518] - corosync-cpg is now online
Oct 15 15:15:52 vm3 crmd[8202]:     info: pcmk_cpg_membership: Member[0.2] crmd.3232261519 
Oct 15 15:15:52 vm3 crmd[8202]:     info: crm_get_peer: Node 3232261517 is now known as vm1
Oct 15 15:15:52 vm3 crmd[8202]:     info: peer_update_callback: vm1 is now member
Oct 15 15:15:52 vm3 crmd[8202]:     info: crm_get_peer: Node 3232261518 is now known as vm2
Oct 15 15:15:52 vm3 crmd[8202]:     info: peer_update_callback: vm2 is now member
Oct 15 15:15:53 vm3 stonith-ng[8198]:     info: crm_client_new: Connecting 0x1daeb40 for uid=496 gid=492 pid=8202 id=e33a7d26-10b7-4b5c-9280-586dce779df9
Oct 15 15:15:53 vm3 stonith-ng[8198]:     info: stonith_command: Processed register from crmd.8202: OK (0)
Oct 15 15:15:53 vm3 stonith-ng[8198]:     info: stonith_command: Processed st_notify from crmd.8202: OK (0)
Oct 15 15:15:53 vm3 stonith-ng[8198]:     info: stonith_command: Processed st_notify from crmd.8202: OK (0)
Oct 15 15:16:12 vm3 crmd[8202]:     info: election_count_vote: Election 1 (owner: 3232261518) pass: vote from vm2 (Uptime)
Oct 15 15:16:12 vm3 crmd[8202]:     info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Oct 15 15:16:12 vm3 crmd[8202]:     info: election_count_vote: Election 1 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:12 vm3 crmd[8202]:   notice: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Oct 15 15:16:12 vm3 crmd[8202]:     info: do_dc_release: DC role released
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_slave operation for section 'all': OK (rc=0, origin=local/crmd/6, version=0.0.0)
Oct 15 15:16:12 vm3 crmd[8202]:     info: do_te_control: Transitioner is now inactive
Oct 15 15:16:12 vm3 crmd[8202]:     info: do_log: FSA: Input I_RELEASE_SUCCESS from do_dc_release() received in state S_PENDING
Oct 15 15:16:12 vm3 crmd[8202]:     info: do_log: FSA: Input I_PENDING from do_election_count_vote() received in state S_PENDING
Oct 15 15:16:12 vm3 crmd[8202]:     info: election_count_vote: Election 2 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:12 vm3 crmd[8202]:     info: do_log: FSA: Input I_PENDING from do_election_count_vote() received in state S_PENDING
Oct 15 15:16:12 vm3 cib[8197]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:16:12 vm3 cib[8197]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:16:12 vm3 cib[8197]:     info: crm_get_peer: Node 3232261517 is now known as vm1
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section cib: OK (rc=0, origin=vm1/crmd/7, version=0.0.1)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section crm_config: OK (rc=0, origin=vm1/crmd/9, version=0.1.1)
Oct 15 15:16:12 vm3 crmd[8202]:     info: update_dc: Set DC to vm1 (3.0.7)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/7, version=0.1.1)
Oct 15 15:16:12 vm3 crmd[8202]:     info: election_count_vote: Election 3 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:12 vm3 crmd[8202]:     info: update_dc: Unset DC. Was vm1
Oct 15 15:16:12 vm3 crmd[8202]:     info: do_log: FSA: Input I_PENDING from do_election_count_vote() received in state S_PENDING
Oct 15 15:16:12 vm3 crmd[8202]:     info: update_dc: Set DC to vm1 (3.0.7)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/8, version=0.1.1)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section crm_config: OK (rc=0, origin=vm1/crmd/11, version=0.2.1)
Oct 15 15:16:12 vm3 cib[8204]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-0.raw
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_replace: Digest matched on replace from vm1: 534642ef8fd2ad2ffdb8dd568d6f7c3a
Oct 15 15:16:12 vm3 crmd[8202]:     info: erase_status_tag: Deleting xpath: //node_state[@uname='vm3']/transient_attributes
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_replace: Replaced 0.2.1 with 0.2.1 from vm1
Oct 15 15:16:12 vm3 crmd[8202]:     info: update_attrd_helper: Connecting to attrd... 5 retries remaining
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_replace operation for section 'all': OK (rc=0, origin=vm1/crmd/17, version=0.2.1)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Forwarding cib_delete operation for section //node_state[@uname='vm3']/transient_attributes to master (origin=local/crmd/9)
Oct 15 15:16:12 vm3 cib[8204]:     info: write_cib_contents: Wrote version 0.1.0 of the CIB to disk (digest: 51521f2153f57cb386e10b5d3317b80b)
Oct 15 15:16:12 vm3 attrd[8200]:     info: crm_client_new: Connecting 0x99cff0 for uid=496 gid=492 pid=8202 id=9c00770f-bd34-4c10-b1b2-f10145eb0887
Oct 15 15:16:12 vm3 cib[8197]:     info: crm_get_peer: Node 3232261518 is now known as vm2
Oct 15 15:16:12 vm3 crmd[8202]:     info: do_log: FSA: Input I_NOT_DC from do_cl_join_finalize_respond() received in state S_PENDING
Oct 15 15:16:12 vm3 crmd[8202]:   notice: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Oct 15 15:16:12 vm3 attrd[8200]:     info: attrd_client_message: Starting an election to determine the writer
Oct 15 15:16:12 vm3 cib[8204]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.IRYnvF (digest: /var/lib/pacemaker/cib/cib.aRw0ga)
Oct 15 15:16:12 vm3 attrd[8200]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261519
Oct 15 15:16:12 vm3 attrd[8200]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 15 15:16:12 vm3 attrd[8200]:     info: attrd_client_message: Broadcasting terminate[vm3] = (null)
Oct 15 15:16:12 vm3 attrd[8200]:     info: attrd_client_message: Broadcasting shutdown[vm3] = (null)
Oct 15 15:16:12 vm3 cib[8205]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-1.raw
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section nodes: OK (rc=0, origin=vm1/crmd/18, version=0.3.1)
Oct 15 15:16:12 vm3 cib[8205]:     info: write_cib_contents: Wrote version 0.2.0 of the CIB to disk (digest: de05f774f8d9c411f636e16f725bf956)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section nodes: OK (rc=0, origin=vm1/crmd/19, version=0.4.1)
Oct 15 15:16:12 vm3 attrd[8200]:     info: crm_get_peer: Node 3232261518 is now known as vm2
Oct 15 15:16:12 vm3 attrd[8200]:     info: election_count_vote: Election 1 (owner: 3232261518) lost: vote from vm2 (Host name)
Oct 15 15:16:12 vm3 cib[8205]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.fp9uyH (digest: /var/lib/pacemaker/cib/cib.zrMoqc)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section nodes: OK (rc=0, origin=vm1/crmd/20, version=0.5.1)
Oct 15 15:16:12 vm3 attrd[8200]:     info: election_count_vote: Election 2 (owner: 3232261518) lost: vote from vm2 (Host name)
Oct 15 15:16:12 vm3 attrd[8200]:     info: crm_get_peer: Node 3232261517 is now known as vm1
Oct 15 15:16:12 vm3 attrd[8200]:     info: election_count_vote: Election 1 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:12 vm3 attrd[8200]:     info: election_count_vote: Election 2 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/23, version=0.5.2)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/25, version=0.5.3)
Oct 15 15:16:12 vm3 attrd[8200]:     info: election_count_vote: Election 3 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:12 vm3 attrd[8200]:     info: election_count_vote: Election 4 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:12 vm3 cib[8206]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-2.raw
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/27, version=0.5.4)
Oct 15 15:16:12 vm3 attrd[8200]:   notice: attrd_peer_message: Processing sync-response from vm1
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section cib: OK (rc=0, origin=vm1/crmd/30, version=0.5.5)
Oct 15 15:16:12 vm3 cib[8206]:     info: write_cib_contents: Wrote version 0.5.0 of the CIB to disk (digest: 034de6ab489c499a76b66b8122cf302a)
Oct 15 15:16:12 vm3 cib[8206]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.bnOvdK (digest: /var/lib/pacemaker/cib/cib.LY37af)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/attrd/2, version=0.5.6)
Oct 15 15:16:12 vm3 attrd[8200]:     info: attrd_client_message: Broadcasting probe_complete[vm3] = true
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/attrd/4, version=0.5.7)
Oct 15 15:16:12 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/attrd/5, version=0.5.8)
Oct 15 15:16:21 vm3 crmd[8202]:     info: election_count_vote: Election 4 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:21 vm3 crmd[8202]:     info: update_dc: Unset DC. Was vm1
Oct 15 15:16:21 vm3 crmd[8202]:     info: do_log: FSA: Input I_PENDING from do_election_count_vote() received in state S_NOT_DC
Oct 15 15:16:21 vm3 crmd[8202]:   notice: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_slave operation for section 'all': OK (rc=0, origin=local/crmd/10, version=0.5.8)
Oct 15 15:16:21 vm3 stonith-ng[8198]:     info: stonith_level_remove: Node vm3 not found (0 active entries)
Oct 15 15:16:21 vm3 stonith-ng[8198]:     info: stonith_level_register: Node vm3 has 1 active fencing levels
Oct 15 15:16:21 vm3 stonith-ng[8198]:     info: stonith_level_register: Node vm3 has 2 active fencing levels
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=vm1/cibadmin/2, version=0.6.1)
Oct 15 15:16:21 vm3 stonith-ng[8198]:     info: update_cib_stonith_devices: Updating device list from the cib: new resource
Oct 15 15:16:21 vm3 stonith-ng[8198]:  warning: handle_startup_fencing: Blind faith: not fencing unseen nodes
Oct 15 15:16:21 vm3 stonith-ng[8198]:     info: cib_device_update: Device f1 has been disabled on vm3: score=-INFINITY
Oct 15 15:16:21 vm3 stonith-ng[8198]:     info: cib_device_update: Device f2 is allowed on vm3: score=0
Oct 15 15:16:21 vm3 stonith-ng[8198]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 15 15:16:21 vm3 cib[8207]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-3.raw
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section crm_config: OK (rc=0, origin=vm1/crmd/39, version=0.7.1)
Oct 15 15:16:21 vm3 crmd[8202]:     info: update_dc: Set DC to vm1 (3.0.7)
Oct 15 15:16:21 vm3 crmd[8202]:     info: election_count_vote: Election 5 (owner: 3232261517) lost: vote from vm1 (Uptime)
Oct 15 15:16:21 vm3 crmd[8202]:     info: update_dc: Unset DC. Was vm1
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/11, version=0.7.1)
Oct 15 15:16:21 vm3 crmd[8202]:     info: update_dc: Set DC to vm1 (3.0.7)
Oct 15 15:16:21 vm3 crmd[8202]:     info: do_log: FSA: Input I_PENDING from do_election_count_vote() received in state S_PENDING
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/12, version=0.7.1)
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section crm_config: OK (rc=0, origin=vm1/crmd/41, version=0.8.1)
Oct 15 15:16:21 vm3 cib[8207]:     info: write_cib_contents: Wrote version 0.6.0 of the CIB to disk (digest: 45e2cff77ab7d1f709fb4b3254f8e13b)
Oct 15 15:16:21 vm3 cib[8207]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.C5bw68 (digest: /var/lib/pacemaker/cib/cib.FCIYD2)
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_replace: Digest matched on replace from vm1: b72b19965fead91bc6f322209ac3483d
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_replace: Replaced 0.8.1 with 0.8.1 from vm1
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_replace operation for section 'all': OK (rc=0, origin=vm1/crmd/47, version=0.8.1)
Oct 15 15:16:21 vm3 crmd[8202]:     info: do_log: FSA: Input I_NOT_DC from do_cl_join_finalize_respond() received in state S_PENDING
Oct 15 15:16:21 vm3 crmd[8202]:   notice: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Oct 15 15:16:21 vm3 cib[8209]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-4.raw
Oct 15 15:16:21 vm3 cib[8209]:     info: write_cib_contents: Wrote version 0.8.0 of the CIB to disk (digest: 560938b85dddf6a8da1def7aa23e6520)
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section //node_state[@uname='vm3']/lrm: OK (rc=0, origin=vm1/crmd/51, version=0.8.2)
Oct 15 15:16:21 vm3 cib[8209]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.UT1kaa (digest: /var/lib/pacemaker/cib/cib.wmmIP3)
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/52, version=0.8.3)
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section //node_state[@uname='vm1']/lrm: OK (rc=0, origin=vm1/crmd/53, version=0.8.4)
Oct 15 15:16:21 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/54, version=0.8.5)
Oct 15 15:16:22 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section //node_state[@uname='vm2']/lrm: OK (rc=0, origin=vm1/crmd/55, version=0.8.6)
Oct 15 15:16:22 vm3 cib[8210]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-5.raw
Oct 15 15:16:22 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/56, version=0.8.7)
Oct 15 15:16:22 vm3 cib[8210]:     info: write_cib_contents: Wrote version 0.8.0 of the CIB to disk (digest: b0ac20e1d3cc6eb5c3645ab477efa91f)
Oct 15 15:16:22 vm3 cib[8210]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.EPF7u5 (digest: /var/lib/pacemaker/cib/cib.KAcPiZ)
Oct 15 15:16:22 vm3 stonith-ng[8198]:   notice: stonith_device_register: Added 'f2' to the device list (1 active devices)
Oct 15 15:16:24 vm3 lrmd[8199]:     info: process_lrmd_get_rsc_info: Resource 'pDummy' not found (0 active resources)
Oct 15 15:16:24 vm3 lrmd[8199]:     info: process_lrmd_rsc_register: Added 'pDummy' to the rsc list (1 active resources)
Oct 15 15:16:24 vm3 crmd[8202]:     info: do_lrm_rsc_op: Performing key=12:1:7:cffe5b98-3c92-4ed3-8992-426ef00df4ed op=pDummy_monitor_0
Oct 15 15:16:24 vm3 lrmd[8199]:     info: process_lrmd_get_rsc_info: Resource 'f1' not found (1 active resources)
Oct 15 15:16:24 vm3 lrmd[8199]:     info: process_lrmd_rsc_register: Added 'f1' to the rsc list (2 active resources)
Oct 15 15:16:24 vm3 crmd[8202]:     info: do_lrm_rsc_op: Performing key=13:1:7:cffe5b98-3c92-4ed3-8992-426ef00df4ed op=f1_monitor_0
Oct 15 15:16:24 vm3 stonith-ng[8198]:     info: crm_client_new: Connecting 0x1ddefa0 for uid=0 gid=0 pid=8199 id=b9750954-4ec9-4c27-9bf3-f9d424b67561
Oct 15 15:16:24 vm3 stonith-ng[8198]:     info: stonith_command: Processed register from lrmd.8199: OK (0)
Oct 15 15:16:24 vm3 stonith-ng[8198]:     info: stonith_command: Processed st_notify from lrmd.8199: OK (0)
Oct 15 15:16:24 vm3 lrmd[8199]:     info: process_lrmd_get_rsc_info: Resource 'f2' not found (2 active resources)
Oct 15 15:16:24 vm3 lrmd[8199]:     info: process_lrmd_rsc_register: Added 'f2' to the rsc list (3 active resources)
Oct 15 15:16:24 vm3 crmd[8202]:     info: do_lrm_rsc_op: Performing key=14:1:7:cffe5b98-3c92-4ed3-8992-426ef00df4ed op=f2_monitor_0
Oct 15 15:16:24 vm3 Dummy(pDummy)[8212]: DEBUG: pDummy monitor : 7
Oct 15 15:16:24 vm3 crmd[8202]:     info: process_lrm_event: LRM operation f1_monitor_0 (call=9, rc=7, cib-update=13, confirmed=true) not running
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Forwarding cib_modify operation for section status to master (origin=local/crmd/13)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/13, version=0.8.8)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/13, version=0.8.9)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/61, version=0.8.10)
Oct 15 15:16:24 vm3 crmd[8202]:     info: process_lrm_event: LRM operation f2_monitor_0 (call=13, rc=7, cib-update=14, confirmed=true) not running
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Forwarding cib_modify operation for section status to master (origin=local/crmd/14)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/14, version=0.8.11)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/14, version=0.8.12)
Oct 15 15:16:24 vm3 crmd[8202]:     info: services_os_action_execute: Managed Dummy_meta-data_0 process 8246 exited with rc=0
Oct 15 15:16:24 vm3 crmd[8202]:   notice: process_lrm_event: LRM operation pDummy_monitor_0 (call=5, rc=7, cib-update=15, confirmed=true) not running
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Forwarding cib_modify operation for section status to master (origin=local/crmd/15)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/15, version=0.8.13)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/15, version=0.8.14)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/62, version=0.8.15)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/63, version=0.8.16)
Oct 15 15:16:24 vm3 attrd[8200]:     info: attrd_client_message: Broadcasting probe_complete[vm3] = true
Oct 15 15:16:24 vm3 crmd[8202]:     info: do_lrm_rsc_op: Performing key=15:1:0:cffe5b98-3c92-4ed3-8992-426ef00df4ed op=pDummy_start_0
Oct 15 15:16:24 vm3 lrmd[8199]:     info: log_execute: executing - rsc:pDummy action:start call_id:14
Oct 15 15:16:24 vm3 Dummy(pDummy)[8250]: DEBUG: pDummy start : 0
Oct 15 15:16:24 vm3 lrmd[8199]:     info: log_finished: finished - rsc:pDummy action:start call_id:14 pid:8250 exit-code:0 exec-time:54ms queue-time:1ms
Oct 15 15:16:24 vm3 crmd[8202]:   notice: process_lrm_event: LRM operation pDummy_start_0 (call=14, rc=0, cib-update=16, confirmed=true) ok
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Forwarding cib_modify operation for section status to master (origin=local/crmd/16)
Oct 15 15:16:24 vm3 crmd[8202]:     info: do_lrm_rsc_op: Performing key=16:1:0:cffe5b98-3c92-4ed3-8992-426ef00df4ed op=pDummy_monitor_10000
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/16, version=0.8.17)
Oct 15 15:16:24 vm3 Dummy(pDummy)[8259]: DEBUG: pDummy monitor : 0
Oct 15 15:16:24 vm3 crmd[8202]:   notice: process_lrm_event: LRM operation pDummy_monitor_10000 (call=15, rc=0, cib-update=17, confirmed=false) ok
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Forwarding cib_modify operation for section status to master (origin=local/crmd/17)
Oct 15 15:16:24 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/17, version=0.8.18)
Oct 15 15:16:26 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/64, version=0.8.19)
Oct 15 15:16:27 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/65, version=0.8.20)
Oct 15 15:16:28 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/66, version=0.8.21)
Oct 15 15:16:29 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/67, version=0.8.22)
Oct 15 15:16:34 vm3 Dummy(pDummy)[8267]: DEBUG: pDummy monitor : 0
Oct 15 15:16:44 vm3 Dummy(pDummy)[8281]: DEBUG: pDummy monitor : 0
Oct 15 15:16:54 vm3 Dummy(pDummy)[8289]: DEBUG: pDummy monitor : 0
Oct 15 15:17:04 vm3 Dummy(pDummy)[8299]: DEBUG: pDummy monitor : 7
Oct 15 15:17:04 vm3 crmd[8202]:   notice: process_lrm_event: LRM operation pDummy_monitor_10000 (call=15, rc=7, cib-update=18, confirmed=false) not running
Oct 15 15:17:04 vm3 cib[8197]:     info: cib_process_request: Forwarding cib_modify operation for section status to master (origin=local/crmd/18)
Oct 15 15:17:04 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/crmd/18, version=0.8.23)
Oct 15 15:17:04 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/attrd/9, version=0.8.24)
Oct 15 15:17:04 vm3 cib[8197]:     info: cib_process_request: Completed cib_apply_diff operation for section status: OK (rc=0, origin=vm1/attrd/10, version=0.8.25)
Oct 15 15:17:06 vm3 stonith-ng[8198]:     info: stonith_command: Processed st_query from vm1: OK (0)
Oct 15 15:17:06 vm3 stonith-ng[8198]:     info: stonith_action_create: Initiating action list for agent fence_legacy (target=(null))
Oct 15 15:17:06 vm3 stonith-ng[8198]:     info: dynamic_list_search_cb: Refreshing port list for f2
Oct 15 15:17:14 vm3 Dummy(pDummy)[8336]: DEBUG: pDummy monitor : 7
Oct 15 15:17:24 vm3 Dummy(pDummy)[8439]: DEBUG: pDummy monitor : 7
Oct 15 15:17:34 vm3 Dummy(pDummy)[8599]: DEBUG: pDummy monitor : 7
Oct 15 15:17:35 vm3 stonith-ng[8198]:   notice: remote_op_done: Operation reboot of vm3 by vm1 for crmd.14874@vm1.c9b3e4f1: Generic Pacemaker error
Oct 15 15:17:35 vm3 stonith-ng[8198]:     info: stonith_command: Processed st_notify reply from vm1: OK (0)
Oct 15 15:17:35 vm3 crmd[8202]:   notice: tengine_stonith_notify: Peer vm3 was not terminated (reboot) by vm1 for vm1: Generic Pacemaker error (ref=c9b3e4f1-269f-48a8-ba27-c7573dead8e2) by client crmd.14874
Oct 15 15:17:37 vm3 stonith-ng[8198]:   notice: can_fence_host_with_device: f2 can fence vm3: dynamic-list
Oct 15 15:17:37 vm3 stonith-ng[8198]:     info: stonith_command: Processed st_query from vm1: OK (0)
Oct 15 15:17:44 vm3 Dummy(pDummy)[8652]: DEBUG: pDummy monitor : 7
Oct 15 15:17:54 vm3 Dummy(pDummy)[8660]: DEBUG: pDummy monitor : 7
Oct 15 15:18:04 vm3 Dummy(pDummy)[8668]: DEBUG: pDummy monitor : 7
Oct 15 15:18:06 vm3 stonith-ng[8198]:   notice: remote_op_done: Operation reboot of vm3 by vm1 for crmd.14874@vm1.d5bd243d: Generic Pacemaker error
Oct 15 15:18:06 vm3 stonith-ng[8198]:     info: stonith_command: Processed st_notify reply from vm1: OK (0)
Oct 15 15:18:06 vm3 crmd[8202]:   notice: tengine_stonith_notify: Peer vm3 was not terminated (reboot) by vm1 for vm1: Generic Pacemaker error (ref=d5bd243d-da15-4098-80ab-c9f1bce3827f) by client crmd.14874
Oct 15 15:18:08 vm3 stonith-ng[8198]:     info: stonith_command: Processed st_query from vm1: OK (0)
Oct 15 15:18:08 vm3 stonith-ng[8198]:     info: stonith_action_create: Initiating action list for agent fence_legacy (target=(null))
Oct 15 15:18:08 vm3 stonith-ng[8198]:     info: dynamic_list_search_cb: Refreshing port list for f2
Oct 15 15:18:14 vm3 Dummy(pDummy)[8687]: DEBUG: pDummy monitor : 7
Oct 15 15:18:25 vm3 Dummy(pDummy)[8695]: DEBUG: pDummy monitor : 7
