Sep 27 11:44:09 bl460g1n13 heartbeat: [16301]: WARN: heartbeat: udp port 699 reserved for service "accessnetwork".
Sep 27 11:44:09 bl460g1n13 heartbeat: [16301]: WARN: Logging daemon is disabled --enabling logging daemon is recommended
Sep 27 11:44:09 bl460g1n13 heartbeat: [16301]: info: **************************
Sep 27 11:44:09 bl460g1n13 heartbeat: [16301]: info: Configuration validated. Starting heartbeat 3.0.5
Sep 27 11:44:09 bl460g1n13 heartbeat: [16302]: info: heartbeat: version 3.0.5
Sep 27 11:44:10 bl460g1n13 heartbeat: [16302]: info: Heartbeat generation: 1308643682
Sep 27 11:44:10 bl460g1n13 heartbeat: [16302]: info: glib: UDP Broadcast heartbeat started on port 699 (699) interface eth2
Sep 27 11:44:10 bl460g1n13 heartbeat: [16302]: info: glib: UDP Broadcast heartbeat closed on port 699 interface eth2 - Status: 1
Sep 27 11:44:10 bl460g1n13 heartbeat: [16302]: notice: Using watchdog device: /dev/watchdog
Sep 27 11:44:10 bl460g1n13 heartbeat: [16302]: info: Local status now set to: 'up'
Sep 27 11:44:11 bl460g1n13 heartbeat: [16302]: info: Link bl460g1n13:eth2 up.
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Link bl460g1n14:eth2 up.
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Status update for node bl460g1n14: status up
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: debug: get_delnodelist: delnodelist= 
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Comm_now_up(): updating status to active
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Local status now set to: 'active'
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Starting child client "/usr/lib64/heartbeat/ccm" (101,157)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Starting child client "/usr/lib64/heartbeat/cib" (101,157)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Starting child client "/usr/lib64/heartbeat/lrmd -r" (0,0)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Starting child client "/usr/lib64/heartbeat/stonithd" (0,0)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Starting child client "/usr/lib64/heartbeat/attrd" (101,157)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Starting child client "/usr/lib64/heartbeat/crmd" (101,157)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16302]: info: Status update for node bl460g1n14: status active
Sep 27 11:44:15 bl460g1n13 heartbeat: [16315]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 101  gid 157 (pid 16315)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16314]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 101  gid 157 (pid 16314)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16310]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 101  gid 157 (pid 16310)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16311]: info: Starting "/usr/lib64/heartbeat/cib" as uid 101  gid 157 (pid 16311)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16312]: info: Starting "/usr/lib64/heartbeat/lrmd -r" as uid 0  gid 0 (pid 16312)
Sep 27 11:44:15 bl460g1n13 heartbeat: [16313]: info: Starting "/usr/lib64/heartbeat/stonithd" as uid 0  gid 0 (pid 16313)
Sep 27 11:44:15 bl460g1n13 crmd: [16315]: info: Invoked: /usr/lib64/heartbeat/crmd 
Sep 27 11:44:15 bl460g1n13 attrd: [16314]: info: Invoked: /usr/lib64/heartbeat/attrd 
Sep 27 11:44:15 bl460g1n13 ccm: [16310]: info: Hostname: bl460g1n13
Sep 27 11:44:15 bl460g1n13 cib: [16311]: info: Invoked: /usr/lib64/heartbeat/cib 
Sep 27 11:44:15 bl460g1n13 lrmd: [16312]: info: enabling coredumps
Sep 27 11:44:15 bl460g1n13 crmd: [16315]: info: main: CRM Hg Version: a15ead49e20f stable-1.0 tip 
Sep 27 11:44:15 bl460g1n13 attrd: [16314]: info: main: Starting up
Sep 27 11:44:15 bl460g1n13 cib: [16311]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Sep 27 11:44:15 bl460g1n13 lrmd: [16312]: info: Started.
Sep 27 11:44:16 bl460g1n13 crmd: [16315]: info: crmd_init: Starting crmd
Sep 27 11:44:16 bl460g1n13 heartbeat: [16302]: info: the send queue length from heartbeat to client ccm is set to 1024
Sep 27 11:44:16 bl460g1n13 stonithd: [16313]: info: register_heartbeat_conn: Hostname: bl460g1n13
Sep 27 11:44:16 bl460g1n13 cib: [16311]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Sep 27 11:44:16 bl460g1n13 heartbeat: [16302]: WARN: G_CH_dispatch_int: Dispatch function for API client took too long to execute: 140 ms (> 100 ms) (GSource: 0x10bd4660)
Sep 27 11:44:16 bl460g1n13 stonithd: [16313]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Sep 27 11:44:16 bl460g1n13 cib: [16311]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Sep 27 11:44:16 bl460g1n13 stonithd: [16313]: info: crm_cluster_connect: Connecting to Heartbeat
Sep 27 11:44:16 bl460g1n13 cib: [16311]: WARN: readCibXmlFile: Continuing with an empty configuration.
Sep 27 11:44:16 bl460g1n13 cib: [16311]: info: startCib: CIB Initialization completed successfully
Sep 27 11:44:16 bl460g1n13 heartbeat: [16302]: info: the send queue length from heartbeat to client stonithd is set to 1024
Sep 27 11:44:16 bl460g1n13 attrd: [16314]: info: register_heartbeat_conn: Hostname: bl460g1n13
Sep 27 11:44:16 bl460g1n13 stonithd: [16313]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
Sep 27 11:44:16 bl460g1n13 cib: [16311]: info: register_heartbeat_conn: Hostname: bl460g1n13
Sep 27 11:44:16 bl460g1n13 attrd: [16314]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Sep 27 11:44:16 bl460g1n13 cib: [16311]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Sep 27 11:44:16 bl460g1n13 attrd: [16314]: info: crm_cluster_connect: Connecting to Heartbeat
Sep 27 11:44:16 bl460g1n13 cib: [16311]: info: crm_cluster_connect: Connecting to Heartbeat
Sep 27 11:44:16 bl460g1n13 attrd: [16314]: info: main: Cluster connection active
Sep 27 11:44:16 bl460g1n13 cib: [16311]: info: ccm_connect: Registering with CCM...
Sep 27 11:44:16 bl460g1n13 heartbeat: [16302]: info: the send queue length from heartbeat to client attrd is set to 1024
Sep 27 11:44:16 bl460g1n13 attrd: [16314]: info: main: Accepting attribute updates
Sep 27 11:44:16 bl460g1n13 cib: [16311]: info: cib_init: Requesting the list of configured nodes
Sep 27 11:44:16 bl460g1n13 heartbeat: [16302]: info: the send queue length from heartbeat to client cib is set to 1024
Sep 27 11:44:16 bl460g1n13 attrd: [16314]: info: main: Starting mainloop...
Sep 27 11:44:16 bl460g1n13 heartbeat: [16302]: WARN: G_CH_dispatch_int: Dispatch function for API client took too long to execute: 110 ms (> 100 ms) (GSource: 0x10bd5c50)
Sep 27 11:44:17 bl460g1n13 cib: [16311]: info: cib_init: Starting cib mainloop
Sep 27 11:44:17 bl460g1n13 cib: [16311]: info: cib_client_status_callback: Status update: Client bl460g1n13/cib now has status [join]
Sep 27 11:44:17 bl460g1n13 cib: [16311]: info: crm_new_peer: Node 0 is now known as bl460g1n13
Sep 27 11:44:17 bl460g1n13 cib: [16311]: info: crm_update_peer_proc: bl460g1n13.cib is now online
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: do_cib_control: CIB connection established
Sep 27 11:44:17 bl460g1n13 cib: [16318]: info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 870a6c3b22a0a303825511419264c7c1)
Sep 27 11:44:17 bl460g1n13 cib: [16311]: info: cib_client_status_callback: Status update: Client bl460g1n13/cib now has status [online]
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: register_heartbeat_conn: Hostname: bl460g1n13
Sep 27 11:44:17 bl460g1n13 cib: [16318]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.YIvizs (digest: /var/lib/heartbeat/crm/cib.lGby9s)
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: crm_cluster_connect: Connecting to Heartbeat
Sep 27 11:44:17 bl460g1n13 cib: [16311]: info: cib_client_status_callback: Status update: Client bl460g1n14/cib now has status [online]
Sep 27 11:44:17 bl460g1n13 heartbeat: [16302]: info: the send queue length from heartbeat to client crmd is set to 1024
Sep 27 11:44:17 bl460g1n13 cib: [16311]: info: crm_new_peer: Node 0 is now known as bl460g1n14
Sep 27 11:44:17 bl460g1n13 cib: [16311]: info: crm_update_peer_proc: bl460g1n14.cib is now online
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: do_ha_control: Connected to the cluster
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: do_ccm_control: CCM connection established... waiting for first callback
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: crmd_init: Starting crmd's mainloop
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: info: config_query_callback: Checking for expired actions every 900000ms
Sep 27 11:44:17 bl460g1n13 crmd: [16315]: notice: crmd_client_status_callback: Status update: Client bl460g1n13/crmd now has status [online] (DC=false)
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: info: crm_new_peer: Node 0 is now known as bl460g1n13
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: info: crm_update_peer_proc: bl460g1n13.crmd is now online
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: info: crmd_client_status_callback: Not the DC
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: notice: crmd_client_status_callback: Status update: Client bl460g1n13/crmd now has status [online] (DC=false)
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: info: crmd_client_status_callback: Not the DC
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: notice: crmd_client_status_callback: Status update: Client bl460g1n14/crmd now has status [offline] (DC=false)
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: info: crm_new_peer: Node 0 is now known as bl460g1n14
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: info: crmd_client_status_callback: Not the DC
Sep 27 11:44:18 bl460g1n13 crmd: [16315]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: cib_ccm_msg_callback: Processing CCM event=NEW MEMBERSHIP (id=2)
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: ccm_event_detail: 	CURRENT: bl460g1n14 [nodeid=1, born=1]
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: ccm_event_detail: 	CURRENT: bl460g1n13 [nodeid=0, born=2]
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: ccm_event_detail: 	NEW:     bl460g1n14 [nodeid=1, born=1]
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: crm_get_peer: Node bl460g1n14 now has id: 1
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: crm_update_peer: Node bl460g1n14: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000100
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: crm_update_peer_proc: bl460g1n14.ais is now online
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: ccm_event_detail: 	NEW:     bl460g1n13 [nodeid=0, born=2]
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: crm_update_peer_proc: bl460g1n14.crmd is now online
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: crm_get_peer: Node bl460g1n14 now has id: 1
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: crm_update_peer: Node bl460g1n13: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000100
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: crm_update_peer: Node bl460g1n14: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000000
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: crm_update_peer_proc: bl460g1n13.ais is now online
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: crm_update_peer_proc: bl460g1n14.ais is now online
Sep 27 11:44:20 bl460g1n13 cib: [16311]: info: crm_update_peer_proc: bl460g1n13.crmd is now online
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: crm_update_peer_proc: bl460g1n14.crmd is now online
Sep 27 11:44:20 bl460g1n13 heartbeat: [16302]: WARN: 1 lost packet(s) for [bl460g1n14] [19:21]
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: crm_update_peer: Node bl460g1n13: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000200
Sep 27 11:44:20 bl460g1n13 heartbeat: [16302]: WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 90 ms (> 50 ms) (GSource: 0x10bcbf60)
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: crm_update_peer_proc: bl460g1n13.ais is now online
Sep 27 11:44:20 bl460g1n13 heartbeat: [16302]: info: No pkts missing from bl460g1n14!
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: do_started: The local CRM is operational
Sep 27 11:44:20 bl460g1n13 heartbeat: [16302]: WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 70 ms (> 50 ms) (GSource: 0x10bcbf60)
Sep 27 11:44:20 bl460g1n13 crmd: [16315]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Sep 27 11:44:21 bl460g1n13 attrd: [16314]: info: cib_connect: Connected to the CIB after 1 signon attempts
Sep 27 11:44:21 bl460g1n13 attrd: [16314]: info: cib_connect: Sending full refresh
Sep 27 11:44:21 bl460g1n13 crmd: [16315]: notice: crmd_client_status_callback: Status update: Client bl460g1n14/crmd now has status [online] (DC=false)
Sep 27 11:44:21 bl460g1n13 crmd: [16315]: info: crmd_client_status_callback: Not the DC
Sep 27 11:44:22 bl460g1n13 heartbeat: [16302]: WARN: 1 lost packet(s) for [bl460g1n14] [23:25]
Sep 27 11:44:22 bl460g1n13 heartbeat: [16302]: info: No pkts missing from bl460g1n14!
Sep 27 11:45:21 bl460g1n13 crmd: [16315]: info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped!
Sep 27 11:45:21 bl460g1n13 crmd: [16315]: WARN: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING
Sep 27 11:45:21 bl460g1n13 crmd: [16315]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
Sep 27 11:45:23 bl460g1n13 crmd: [16315]: info: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Sep 27 11:45:23 bl460g1n13 crmd: [16315]: info: do_dc_release: DC role released
Sep 27 11:45:23 bl460g1n13 crmd: [16315]: info: do_te_control: Transitioner is now inactive
Sep 27 11:45:28 bl460g1n13 cib: [16320]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-0.raw
Sep 27 11:45:28 bl460g1n13 cib: [16320]: info: write_cib_contents: Wrote version 0.1.0 of the CIB to disk (digest: 44d4d78afcc797ae908180c4e940ac22)
Sep 27 11:45:28 bl460g1n13 cib: [16320]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.0xubUT (digest: /var/lib/heartbeat/crm/cib.AtjpY2)
Sep 27 11:45:28 bl460g1n13 crmd: [16315]: info: update_dc: Set DC to bl460g1n14 (3.0.1)
Sep 27 11:45:28 bl460g1n13 cib: [16321]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-1.raw
Sep 27 11:45:28 bl460g1n13 cib: [16321]: info: write_cib_contents: Wrote version 0.2.0 of the CIB to disk (digest: 04e9a609d1a1309a0fc4c63dffa0eae3)
Sep 27 11:45:28 bl460g1n13 cib: [16321]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.7zX9H8 (digest: /var/lib/heartbeat/crm/cib.qiK9ii)
Sep 27 11:45:30 bl460g1n13 cib: [16322]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-2.raw
Sep 27 11:45:30 bl460g1n13 cib: [16322]: info: write_cib_contents: Wrote version 0.3.0 of the CIB to disk (digest: 2a39b10b2ee4bd5945e3c3d990fee18f)
Sep 27 11:45:30 bl460g1n13 cib: [16322]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.wSHRDo (digest: /var/lib/heartbeat/crm/cib.JOewOB)
Sep 27 11:45:30 bl460g1n13 crmd: [16315]: info: update_attrd: Connecting to attrd...
Sep 27 11:45:30 bl460g1n13 attrd: [16314]: info: find_hash_entry: Creating hash entry for terminate
Sep 27 11:45:30 bl460g1n13 crmd: [16315]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Sep 27 11:45:30 bl460g1n13 attrd: [16314]: info: find_hash_entry: Creating hash entry for shutdown
Sep 27 11:45:30 bl460g1n13 attrd: [16314]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Sep 27 11:45:30 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
Sep 27 11:45:30 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
Sep 27 11:45:30 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n13
Sep 27 11:45:30 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n13
Sep 27 11:45:30 bl460g1n13 cib: [16323]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-3.raw
Sep 27 11:45:30 bl460g1n13 cib: [16323]: info: write_cib_contents: Wrote version 0.5.0 of the CIB to disk (digest: 395ada1fcc0675ceaf038bf4344666ee)
Sep 27 11:45:30 bl460g1n13 cib: [16323]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.tXMxJe (digest: /var/lib/heartbeat/crm/cib.lP1uOt)
Sep 27 11:45:31 bl460g1n13 crmd: [16315]: info: erase_xpath_callback: Deletion of "//node_state[@uname='bl460g1n13']/transient_attributes": ok (rc=0)
Sep 27 11:45:32 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:32 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:32 bl460g1n13 cib: [16324]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-4.raw
Sep 27 11:45:32 bl460g1n13 cib: [16324]: info: write_cib_contents: Wrote version 0.6.0 of the CIB to disk (digest: 8aac052682096aa5c603b02895e461e6)
Sep 27 11:45:32 bl460g1n13 cib: [16324]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.zIBPaj (digest: /var/lib/heartbeat/crm/cib.taPlGD)
Sep 27 11:45:33 bl460g1n13 attrd: [16314]: info: find_hash_entry: Creating hash entry for probe_complete
Sep 27 11:45:33 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Sep 27 11:45:33 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 10: probe_complete=true
Sep 27 11:45:34 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:34 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 13: probe_complete=true
Sep 27 11:45:38 bl460g1n13 crmd: [16315]: info: update_dc: Unset DC bl460g1n14
Sep 27 11:45:38 bl460g1n13 crmd: [16315]: info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Sep 27 11:45:40 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:40 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:40 bl460g1n13 cib: [16375]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-5.raw
Sep 27 11:45:40 bl460g1n13 cib: [16375]: info: write_cib_contents: Wrote version 0.7.0 of the CIB to disk (digest: d903301c1ebce3115fabd2a545375b9c)
Sep 27 11:45:40 bl460g1n13 cib: [16375]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.MDLMqC (digest: /var/lib/heartbeat/crm/cib.eiFQKi)
Sep 27 11:45:41 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:43 bl460g1n13 crmd: [16315]: info: update_dc: Set DC to bl460g1n14 (3.0.1)
Sep 27 11:45:45 bl460g1n13 crmd: [16315]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Sep 27 11:45:45 bl460g1n13 attrd: [16314]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Sep 27 11:45:45 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Sep 27 11:45:45 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
Sep 27 11:45:45 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
Sep 27 11:45:45 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n13
Sep 27 11:45:45 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n13
Sep 27 11:45:47 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:50 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=4:2:7:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy01_monitor_0 )
Sep 27 11:45:50 bl460g1n13 lrmd: [16312]: info: rsc:dummy01 probe[2] (pid 16379)
Sep 27 11:45:50 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=5:2:7:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy02_monitor_0 )
Sep 27 11:45:50 bl460g1n13 lrmd: [16312]: info: rsc:dummy02 probe[3] (pid 16380)
Sep 27 11:45:50 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=6:2:7:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy03_monitor_0 )
Sep 27 11:45:50 bl460g1n13 lrmd: [16312]: info: rsc:dummy03 probe[4] (pid 16381)
Sep 27 11:45:50 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=7:2:7:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=prmDRBD:0_monitor_0 )
Sep 27 11:45:50 bl460g1n13 lrmd: [16312]: info: rsc:prmDRBD:0 probe[5] (pid 16384)
Sep 27 11:45:50 bl460g1n13 lrmd: [16312]: info: operation monitor[2] on dummy01 for client 16315: pid 16379 exited with return code 7
Sep 27 11:45:50 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy01_monitor_0 (call=2, rc=7, cib-update=12, confirmed=true) not running
Sep 27 11:45:50 bl460g1n13 lrmd: [16312]: info: operation monitor[3] on dummy02 for client 16315: pid 16380 exited with return code 7
Sep 27 11:45:50 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy02_monitor_0 (call=3, rc=7, cib-update=13, confirmed=true) not running
Sep 27 11:45:50 bl460g1n13 lrmd: [16312]: info: operation monitor[4] on dummy03 for client 16315: pid 16381 exited with return code 7
Sep 27 11:45:50 bl460g1n13 attrd: [16314]: info: find_hash_entry: Creating hash entry for dstate-r0
Sep 27 11:45:50 bl460g1n13 drbd[16384]: ERROR: remote  dstate is DUnknown
Sep 27 11:45:50 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy03_monitor_0 (call=4, rc=7, cib-update=14, confirmed=true) not running
Sep 27 11:45:50 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: dstate-r0 (Unconfigured:Unconfigured/DUnknown)
Sep 27 11:45:50 bl460g1n13 crm_attribute: [16423]: info: Invoked: crm_attribute -N bl460g1n13 -n master-prmDRBD:0 -l reboot -D 
Sep 27 11:45:50 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 30: dstate-r0=Unconfigured:Unconfigured/DUnknown
Sep 27 11:45:50 bl460g1n13 lrmd: [16312]: info: operation monitor[5] on prmDRBD:0 for client 16315: pid 16384 exited with return code 7
Sep 27 11:45:50 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:50 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation prmDRBD:0_monitor_0 (call=5, rc=7, cib-update=15, confirmed=true) not running
Sep 27 11:45:50 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 33: dstate-r0=Unconfigured:Unconfigured/DUnknown
Sep 27 11:45:50 bl460g1n13 attrd: [16314]: info: find_hash_entry: Creating hash entry for master-prmDRBD:0
Sep 27 11:45:55 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:55 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=15:3:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=prmDRBD:0_start_0 )
Sep 27 11:45:55 bl460g1n13 lrmd: [16312]: info: rsc:prmDRBD:0 start[6] (pid 16424)
Sep 27 11:45:55 bl460g1n13 drbd[16424]: ERROR: remote  dstate is DUnknown
Sep 27 11:45:55 bl460g1n13 lrmd: [16312]: info: RA output: (prmDRBD:0:start:stdout)  
Sep 27 11:45:55 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: dstate-r0 (StandAlone:Consistent/DUnknown)
Sep 27 11:45:55 bl460g1n13 drbd[16424]: ERROR: remote  dstate is DUnknown
Sep 27 11:45:55 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 37: dstate-r0=StandAlone:Consistent/DUnknown
Sep 27 11:45:55 bl460g1n13 lrmd: [16312]: info: RA output: (prmDRBD:0:start:stdout)  
Sep 27 11:45:55 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: master-prmDRBD:0 (5)
Sep 27 11:45:55 bl460g1n13 lrmd: [16312]: info: operation start[6] on prmDRBD:0 for client 16315: pid 16424 exited with return code 0
Sep 27 11:45:55 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 40: master-prmDRBD:0=5
Sep 27 11:45:55 bl460g1n13 lrmd: [16312]: info: RA output: (prmDRBD:0:start:stdout)  
Sep 27 11:45:55 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation prmDRBD:0_start_0 (call=6, rc=0, cib-update=16, confirmed=true) ok
Sep 27 11:45:55 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:45:56 bl460g1n13 attrd: [16314]: info: find_hash_entry: Creating hash entry for master-prmDRBD:1
Sep 27 11:45:56 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=54:3:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=prmDRBD:0_notify_0 )
Sep 27 11:45:56 bl460g1n13 lrmd: [16312]: info: rsc:prmDRBD:0 notify[7] (pid 16504)
Sep 27 11:45:56 bl460g1n13 lrmd: [16312]: info: RA output: (prmDRBD:0:notify:stdout)  
Sep 27 11:45:56 bl460g1n13 lrmd: [16312]: info: operation notify[7] on prmDRBD:0 for client 16315: pid 16504 exited with return code 0
Sep 27 11:45:56 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation prmDRBD:0_notify_0 (call=7, rc=0, cib-update=17, confirmed=true) ok
Sep 27 11:46:01 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=62:4:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=prmDRBD:0_notify_0 )
Sep 27 11:46:01 bl460g1n13 lrmd: [16312]: info: rsc:prmDRBD:0 notify[8] (pid 16534)
Sep 27 11:46:01 bl460g1n13 lrmd: [16312]: info: operation notify[8] on prmDRBD:0 for client 16315: pid 16534 exited with return code 0
Sep 27 11:46:01 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation prmDRBD:0_notify_0 (call=8, rc=0, cib-update=18, confirmed=true) ok
Sep 27 11:46:03 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=18:4:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=prmDRBD:0_promote_0 )
Sep 27 11:46:03 bl460g1n13 lrmd: [16312]: info: rsc:prmDRBD:0 promote[9] (pid 16557)
Sep 27 11:46:03 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: dstate-r0 (Connected:UpToDate/UpToDate)
Sep 27 11:46:03 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 43: dstate-r0=Connected:UpToDate/UpToDate
Sep 27 11:46:03 bl460g1n13 lrmd: [16312]: info: RA output: (prmDRBD:0:promote:stdout)  
Sep 27 11:46:03 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: dstate-r0 (Connected:UpToDate/UpToDate)
Sep 27 11:46:03 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 45: dstate-r0=Connected:UpToDate/UpToDate
Sep 27 11:46:03 bl460g1n13 lrmd: [16312]: info: operation promote[9] on prmDRBD:0 for client 16315: pid 16557 exited with return code 0
Sep 27 11:46:03 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation prmDRBD:0_promote_0 (call=9, rc=0, cib-update=19, confirmed=true) ok
Sep 27 11:46:04 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=63:4:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=prmDRBD:0_notify_0 )
Sep 27 11:46:04 bl460g1n13 lrmd: [16312]: info: rsc:prmDRBD:0 notify[10] (pid 16588)
Sep 27 11:46:04 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: master-prmDRBD:0 (10000)
Sep 27 11:46:04 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 47: master-prmDRBD:0=10000
Sep 27 11:46:04 bl460g1n13 lrmd: [16312]: info: RA output: (prmDRBD:0:notify:stdout)  
Sep 27 11:46:04 bl460g1n13 lrmd: [16312]: info: operation notify[10] on prmDRBD:0 for client 16315: pid 16588 exited with return code 0
Sep 27 11:46:04 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation prmDRBD:0_notify_0 (call=10, rc=0, cib-update=20, confirmed=true) ok
Sep 27 11:46:04 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:46:08 bl460g1n13 attrd: [16314]: info: attrd_ha_callback: flush message from bl460g1n14
Sep 27 11:46:08 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=5:5:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy01_start_0 )
Sep 27 11:46:08 bl460g1n13 lrmd: [16312]: info: rsc:dummy01 start[11] (pid 16616)
Sep 27 11:46:08 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=19:5:8:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=prmDRBD:0_monitor_10000 )
Sep 27 11:46:08 bl460g1n13 lrmd: [16312]: info: rsc:prmDRBD:0 monitor[12] (pid 16617)
Sep 27 11:46:08 bl460g1n13 lrmd: [16312]: info: operation start[11] on dummy01 for client 16315: pid 16616 exited with return code 0
Sep 27 11:46:08 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy01_start_0 (call=11, rc=0, cib-update=21, confirmed=true) ok
Sep 27 11:46:08 bl460g1n13 lrmd: [16312]: info: operation monitor[12] on prmDRBD:0 for client 16315: pid 16617 exited with return code 8
Sep 27 11:46:08 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation prmDRBD:0_monitor_10000 (call=12, rc=8, cib-update=22, confirmed=false) master
Sep 27 11:46:12 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=9:6:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy01_monitor_10000 )
Sep 27 11:46:12 bl460g1n13 lrmd: [16312]: info: rsc:dummy01 monitor[13] (pid 16653)
Sep 27 11:46:12 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=10:6:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy02_start_0 )
Sep 27 11:46:12 bl460g1n13 lrmd: [16312]: info: rsc:dummy02 start[14] (pid 16654)
Sep 27 11:46:12 bl460g1n13 lrmd: [16312]: info: operation monitor[13] on dummy01 for client 16315: pid 16653 exited with return code 0
Sep 27 11:46:12 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy01_monitor_10000 (call=13, rc=0, cib-update=23, confirmed=false) ok
Sep 27 11:46:12 bl460g1n13 lrmd: [16312]: info: operation start[14] on dummy02 for client 16315: pid 16654 exited with return code 0
Sep 27 11:46:12 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy02_start_0 (call=14, rc=0, cib-update=24, confirmed=true) ok
Sep 27 11:46:13 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=11:6:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy02_monitor_10000 )
Sep 27 11:46:13 bl460g1n13 lrmd: [16312]: info: rsc:dummy02 monitor[15] (pid 16660)
Sep 27 11:46:13 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=12:6:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy03_start_0 )
Sep 27 11:46:13 bl460g1n13 lrmd: [16312]: info: rsc:dummy03 start[16] (pid 16661)
Sep 27 11:46:13 bl460g1n13 lrmd: [16312]: info: operation monitor[15] on dummy02 for client 16315: pid 16660 exited with return code 0
Sep 27 11:46:13 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy02_monitor_10000 (call=15, rc=0, cib-update=25, confirmed=false) ok
Sep 27 11:46:13 bl460g1n13 lrmd: [16312]: info: operation start[16] on dummy03 for client 16315: pid 16661 exited with return code 0
Sep 27 11:46:13 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy03_start_0 (call=16, rc=0, cib-update=26, confirmed=true) ok
Sep 27 11:46:15 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=13:6:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy03_monitor_10000 )
Sep 27 11:46:15 bl460g1n13 lrmd: [16312]: info: rsc:dummy03 monitor[17] (pid 16667)
Sep 27 11:46:15 bl460g1n13 lrmd: [16312]: info: operation monitor[17] on dummy03 for client 16315: pid 16667 exited with return code 0
Sep 27 11:46:15 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy03_monitor_10000 (call=17, rc=0, cib-update=27, confirmed=false) ok
Sep 27 11:46:56 bl460g1n13 attrd: [16314]: info: find_hash_entry: Creating hash entry for fail-count-dummy01
Sep 27 11:46:56 bl460g1n13 attrd: [16314]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-dummy01 (1)
Sep 27 11:46:56 bl460g1n13 attrd: [16314]: info: attrd_perform_update: Sent update 53: fail-count-dummy01=1
Sep 27 11:47:00 bl460g1n13 lrmd: [16312]: info: cancel_op: operation monitor[17] on dummy03 for client 16315, its parameters: CRM_meta_interval=[10000] CRM_meta_on_fail=[restart] CRM_meta_timeout=[120000] crm_feature_set=[3.0.1] CRM_meta_name=[monitor]  cancelled
Sep 27 11:47:00 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=12:7:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy03_stop_0 )
Sep 27 11:47:00 bl460g1n13 lrmd: [16312]: info: rsc:dummy03 stop[18] (pid 16880)
Sep 27 11:47:00 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy03_monitor_10000 (call=17, status=1, cib-update=0, confirmed=true) Cancelled
Sep 27 11:47:00 bl460g1n13 lrmd: [16312]: info: operation stop[18] on dummy03 for client 16315: pid 16880 exited with return code 0
Sep 27 11:47:00 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy03_stop_0 (call=18, rc=0, cib-update=28, confirmed=true) ok
Sep 27 11:47:02 bl460g1n13 lrmd: [16312]: info: cancel_op: operation monitor[15] on dummy02 for client 16315, its parameters: CRM_meta_interval=[10000] CRM_meta_on_fail=[restart] CRM_meta_timeout=[120000] crm_feature_set=[3.0.1] CRM_meta_name=[monitor]  cancelled
Sep 27 11:47:02 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=11:7:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy02_stop_0 )
Sep 27 11:47:02 bl460g1n13 lrmd: [16312]: info: rsc:dummy02 stop[19] (pid 16884)
Sep 27 11:47:02 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy02_monitor_10000 (call=15, status=1, cib-update=0, confirmed=true) Cancelled
Sep 27 11:47:02 bl460g1n13 lrmd: [16312]: info: operation stop[19] on dummy02 for client 16315: pid 16884 exited with return code 0
Sep 27 11:47:02 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy02_stop_0 (call=19, rc=0, cib-update=29, confirmed=true) ok
Sep 27 11:47:03 bl460g1n13 lrmd: [16312]: info: cancel_op: operation monitor[13] on dummy01 for client 16315, its parameters: CRM_meta_interval=[10000] CRM_meta_on_fail=[restart] CRM_meta_timeout=[120000] crm_feature_set=[3.0.1] CRM_meta_name=[monitor]  cancelled
Sep 27 11:47:03 bl460g1n13 crmd: [16315]: info: do_lrm_rsc_op: Performing key=10:7:0:3a06bb3d-6ff7-42cd-a1e4-1b721fa93b53 op=dummy01_stop_0 )
Sep 27 11:47:03 bl460g1n13 lrmd: [16312]: info: rsc:dummy01 stop[20] (pid 16891)
Sep 27 11:47:03 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy01_monitor_10000 (call=13, status=1, cib-update=0, confirmed=true) Cancelled
Sep 27 11:47:04 bl460g1n13 lrmd: [16312]: info: operation stop[20] on dummy01 for client 16315: pid 16891 exited with return code 0
Sep 27 11:47:04 bl460g1n13 crmd: [16315]: info: process_lrm_event: LRM operation dummy01_stop_0 (call=20, rc=0, cib-update=30, confirmed=true) ok
Sep 27 11:47:26 bl460g1n13 root: Mark:HB_REPORT:1317091645
