Jan 30 16:08:34 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e2a2c0 for uid=0 gid=0 pid=15811 id=890480da-aabc-474c-9baa-e0a134142500
Jan 30 16:08:34 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:08:34 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 pacemakerd[15914]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:08:37 rhel64-1 pacemakerd[15914]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:08:37 rhel64-1 pacemakerd[15914]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:08:37 rhel64-1 pgsql(prmPostgresql)[15903]: DEBUG: PostgreSQL is running as a primary.
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=15974 id=5f8a3ee1-d48d-4617-be45-c7c7d323e871
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=15976 id=97c98788-d4bf-4948-bcb0-cb6c4ec74f3f
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/configuration/nodes//node[@id='3232235791']//instance_attributes//nvpair[@name='prmPostgresql-data-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=15983 id=77f44b0b-8248-4fb5-a232-e4e6c1f604a1
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=15985 id=fff67be3-7c49-425b-bd0c-7171b2c79ed7
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='3232235791']//transient_attributes//nvpair[@name='prmPostgresql-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 pgsql(prmPostgresql)[15903]: DEBUG: node_name and data_status is rhel64-2|STREAMING|SYNC
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16010 id=15cddb2b-3541-4d4d-ab15-91e7f280bb7d
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16012 id=64f8274b-001b-42a9-8ae4-0c0f90f6aa8b
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/configuration/nodes//node[@id='3232235796']//instance_attributes//nvpair[@name='prmPostgresql-data-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16019 id=1e7565eb-e6c3-4639-ab95-aa3f126f6455
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16023 id=79c01770-bfa9-45a3-8547-3aefc22ce13a
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='3232235796']//transient_attributes//nvpair[@name='master-prmPostgresql']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16030 id=36de036a-a4db-46c5-bf1a-e42db1744c42
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16032 id=c404d3c4-7f14-45a0-8114-dae9cfc664f7
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='3232235796']//transient_attributes//nvpair[@name='prmPostgresql-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:37 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:40 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:08:46 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e2a2c0 for uid=0 gid=0 pid=16149 id=d4e76b77-dd96-4157-a481-91b0ce4bdf3d
Jan 30 16:08:46 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:08:46 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 pacemakerd[16161]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:08:46 rhel64-1 pacemakerd[16161]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:08:46 rhel64-1 pacemakerd[16161]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:08:46 rhel64-1 pgsql(prmPostgresql)[16150]: DEBUG: PostgreSQL is running as a primary.
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16221 id=f8590ce8-c101-4924-8105-c435097dee2a
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16223 id=a3da9e68-6bed-4da3-a071-a4854c1f03b1
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/configuration/nodes//node[@id='3232235791']//instance_attributes//nvpair[@name='prmPostgresql-data-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16230 id=0e034635-14ed-4c18-85d4-afefd8744710
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16232 id=00c8ba84-12a6-4b75-95b7-22f59a95f9e3
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='3232235791']//transient_attributes//nvpair[@name='prmPostgresql-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 pgsql(prmPostgresql)[16150]: DEBUG: node_name and data_status is rhel64-2|STREAMING|SYNC
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16257 id=4d8c34cb-7aa7-4592-886d-e2d3cb695fa9
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16259 id=953767b8-e259-4afe-8e44-3fe879fe1ba1
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/configuration/nodes//node[@id='3232235796']//instance_attributes//nvpair[@name='prmPostgresql-data-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16266 id=dbe1a8af-b592-42fe-89d7-1b2cb6da94dc
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16270 id=3de99d2f-6b74-42d9-af23-aa3046b00d25
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='3232235796']//transient_attributes//nvpair[@name='master-prmPostgresql']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16277 id=3d16ecd4-4bf8-4746-b42d-8c8f6fefc7d5
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df4d20 for uid=0 gid=0 pid=16279 id=f514784f-c6ac-4cd4-aeef-cef5d29fe82d
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='3232235796']//transient_attributes//nvpair[@name='prmPostgresql-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.3)
Jan 30 16:08:46 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:08:55 rhel64-1 pacemakerd[16383]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:08:55 rhel64-1 pacemakerd[16383]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:08:55 rhel64-1 pacemakerd[16383]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:08:55 rhel64-1 pgsql(prmPostgresql)[16372]: ERROR: command failed: su postgres -c cd /dbfp/pgdata/data; kill -s 0 8519 >/dev/null 2>&1
Jan 30 16:08:55 rhel64-1 pgsql(prmPostgresql)[16372]: INFO: PostgreSQL is down
Jan 30 16:08:55 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation prmPostgresql_monitor_9000 (call=43, rc=7, cib-update=106, confirmed=false) not running
Jan 30 16:08:55 rhel64-1 crmd[8143]:     info: abort_transition_graph: process_graph_event:578 - Triggered transition abort (complete=1, node=rhel64-1, tag=lrm_rsc_op, id=prmPostgresql_last_failure_0, magic=0:7;18:0:8:acf9a2a3-307c-460b-b786-fc20e6b8aad5, cib=0.37.4) : Old event
Jan 30 16:08:55 rhel64-1 crmd[8143]:  warning: update_failcount: Updating failcount for prmPostgresql on rhel64-1 after failed monitor: rc=7 (update=value++, time=1391065735)
Jan 30 16:08:55 rhel64-1 crmd[8143]:     info: process_graph_event: Detected action (0.18) prmPostgresql_monitor_9000.43=not running: failed
Jan 30 16:08:55 rhel64-1 attrd[8141]:     info: attrd_client_message: Expanded fail-count-prmPostgresql=value++ to 1
Jan 30 16:08:55 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting fail-count-prmPostgresql[rhel64-1] = 1 (writer)
Jan 30 16:08:55 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting last-failure-prmPostgresql[rhel64-1] = 1391065735 (writer)
Jan 30 16:08:55 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/106, version=0.37.4)
Jan 30 16:08:55 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 48 with 1 changes for fail-count-prmPostgresql, id=<n/a>, set=(null)
Jan 30 16:08:55 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 49 with 1 changes for last-failure-prmPostgresql, id=<n/a>, set=(null)
Jan 30 16:08:55 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=1, node=rhel64-1, tag=nvpair, id=status-3232235791-fail-count-prmPostgresql, name=fail-count-prmPostgresql, value=1, magic=NA, cib=0.37.5) : Transient attribute: update
Jan 30 16:08:55 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/48, version=0.37.5)
Jan 30 16:08:55 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=1, node=rhel64-1, tag=nvpair, id=status-3232235791-last-failure-prmPostgresql, name=last-failure-prmPostgresql, value=1391065735, magic=NA, cib=0.37.6) : Transient attribute: update
Jan 30 16:08:55 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/49, version=0.37.6)
Jan 30 16:08:55 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 48 for fail-count-prmPostgresql: OK (0)
Jan 30 16:08:55 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 48 for fail-count-prmPostgresql[rhel64-1]=1: OK (0)
Jan 30 16:08:55 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 49 for last-failure-prmPostgresql: OK (0)
Jan 30 16:08:55 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 49 for last-failure-prmPostgresql[rhel64-1]=1391065735: OK (0)
Jan 30 16:08:57 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting prmPostgresql-status[rhel64-2]: HS:sync -> HS:alone from rhel64-2
Jan 30 16:08:57 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 50 with 2 changes for prmPostgresql-status, id=<n/a>, set=(null)
Jan 30 16:08:57 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=1, node=rhel64-2, tag=nvpair, id=status-3232235796-prmPostgresql-status, name=prmPostgresql-status, value=HS:alone, magic=NA, cib=0.37.7) : Transient attribute: update
Jan 30 16:08:57 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/50, version=0.37.7)
Jan 30 16:08:57 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 50 for prmPostgresql-status: OK (0)
Jan 30 16:08:57 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 50 for prmPostgresql-status[rhel64-1]=PRI: OK (0)
Jan 30 16:08:57 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 50 for prmPostgresql-status[rhel64-2]=HS:alone: OK (0)
Jan 30 16:08:57 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting prmPostgresql-xlog-loc[rhel64-2]: (null) -> 0000000010000000 from rhel64-2
Jan 30 16:08:57 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 51 with 2 changes for prmPostgresql-xlog-loc, id=<n/a>, set=(null)
Jan 30 16:08:57 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=1, node=rhel64-2, tag=nvpair, id=status-3232235796-prmPostgresql-xlog-loc, name=prmPostgresql-xlog-loc, value=0000000010000000, magic=NA, cib=0.37.8) : Transient attribute: update
Jan 30 16:08:57 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/51, version=0.37.8)
Jan 30 16:08:57 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 51 for prmPostgresql-xlog-loc: OK (0)
Jan 30 16:08:57 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 51 for prmPostgresql-xlog-loc[rhel64-1]=(null): OK (0)
Jan 30 16:08:57 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 51 for prmPostgresql-xlog-loc[rhel64-2]=0000000010000000: OK (0)
Jan 30 16:08:58 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=16460 id=01b77419-b824-4872-af5d-bc7ba5d7f1c6
Jan 30 16:08:58 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:08:58 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: crm_timer_popped: New Transition Timer (I_PE_CALC) just popped (2000ms)
Jan 30 16:08:59 rhel64-1 crmd[8143]:   notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Jan 30 16:08:59 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/107, version=0.37.8)
Jan 30 16:08:59 rhel64-1 pengine[8142]:   notice: unpack_config: On loss of CCM Quorum: Ignore
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: determine_online_status: Node rhel64-1 is online
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: determine_online_status: Node rhel64-2 is online
Jan 30 16:08:59 rhel64-1 pengine[8142]:  warning: unpack_rsc_op_failure: Processing failed op monitor for prmPostgresql:0 on rhel64-1: not running (7)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: group_print:  Resource Group: master-group
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: native_print:      vip-master#011(ocf::heartbeat:IPaddr2):#011Started rhel64-1 
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: native_print:      vip-rep#011(ocf::heartbeat:IPaddr2):#011Started rhel64-1 
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: clone_print:  Master/Slave Set: msPostgresql [prmPostgresql]
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: native_print:      prmPostgresql#011(ocf::heartbeat:pgsql):#011FAILED Master rhel64-1 
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: short_print:      Slaves: [ rhel64-2 ]
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: clone_print:  Clone Set: clnPingd [prmPingd]
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: short_print:      Started: [ rhel64-1 rhel64-2 ]
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: clone_print:  Clone Set: clnDiskd-Inner [prmDiskd-Inner]
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: short_print:      Started: [ rhel64-1 rhel64-2 ]
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: get_failcount_full: prmPostgresql:0 has failed 1 times on rhel64-1
Jan 30 16:08:59 rhel64-1 pengine[8142]:  warning: common_apply_stickiness: Forcing msPostgresql away from rhel64-1 after 1 failures (max=1)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: get_failcount_full: prmPostgresql:1 has failed 1 times on rhel64-1
Jan 30 16:08:59 rhel64-1 pengine[8142]:  warning: common_apply_stickiness: Forcing msPostgresql away from rhel64-1 after 1 failures (max=1)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: native_color: Resource prmPostgresql:0 cannot run anywhere
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: master_color: Promoting prmPostgresql:1 (Slave rhel64-2)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: master_color: msPostgresql: Promoted 1 instances of a possible 1 to master
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (10s) for vip-master on rhel64-2
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (10s) for vip-rep on rhel64-2
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: RecurringOp: Cancelling action prmPostgresql:1_monitor_10000 (Slave vs. Master)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (9s) for prmPostgresql:1 on rhel64-2
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: RecurringOp: Cancelling action prmPostgresql:1_monitor_10000 (Slave vs. Master)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (9s) for prmPostgresql:1 on rhel64-2
Jan 30 16:08:59 rhel64-1 pengine[8142]:   notice: LogActions: Move    vip-master#011(Started rhel64-1 -> rhel64-2)
Jan 30 16:08:59 rhel64-1 pengine[8142]:   notice: LogActions: Move    vip-rep#011(Started rhel64-1 -> rhel64-2)
Jan 30 16:08:59 rhel64-1 pengine[8142]:   notice: LogActions: Demote  prmPostgresql:0#011(Master -> Stopped rhel64-1)
Jan 30 16:08:59 rhel64-1 pengine[8142]:   notice: LogActions: Promote prmPostgresql:1#011(Slave -> Master rhel64-2)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPingd:0#011(Started rhel64-1)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPingd:1#011(Started rhel64-2)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmDiskd-Inner:0#011(Started rhel64-1)
Jan 30 16:08:59 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmDiskd-Inner:1#011(Started rhel64-2)
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: do_te_invoke: Processing graph 14 (ref=pe_calc-dc-1391065739-113) derived from /var/lib/pacemaker/pengine/pe-input-160.bz2
Jan 30 16:08:59 rhel64-1 pengine[8142]:   notice: process_pe_message: Calculated Transition 14: /var/lib/pacemaker/pengine/pe-input-160.bz2
Jan 30 16:08:59 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 9: cancel prmPostgresql_cancel_10000 on rhel64-2
Jan 30 16:08:59 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 79: notify prmPostgresql_pre_notify_demote_0 on rhel64-1 (local)
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: do_lrm_rsc_op: Performing key=79:14:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5 op=prmPostgresql_notify_0
Jan 30 16:08:59 rhel64-1 lrmd[8140]:     info: log_execute: executing - rsc:prmPostgresql action:notify call_id:54
Jan 30 16:08:59 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 81: notify prmPostgresql_pre_notify_demote_0 on rhel64-2
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_monitor_10000 (9) confirmed on rhel64-2 (rc=0)
Jan 30 16:08:59 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_delete operation for section status: OK (rc=0, origin=rhel64-2/crmd/21, version=0.37.9)
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:258 - Triggered transition abort (complete=0, node=rhel64-2, tag=lrm_rsc_op, id=prmPostgresql_monitor_10000, magic=0:0;26:12:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5, cib=0.37.9) : Resource op removal
Jan 30 16:08:59 rhel64-1 pacemakerd[16472]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:08:59 rhel64-1 pacemakerd[16472]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:08:59 rhel64-1 pacemakerd[16472]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (81) confirmed on rhel64-2 (rc=0)
Jan 30 16:08:59 rhel64-1 pgsql(prmPostgresql)[16461]: DEBUG: notify: pre for demote
Jan 30 16:08:59 rhel64-1 lrmd[8140]:     info: log_finished: finished - rsc:prmPostgresql action:notify call_id:54 pid:16461 exit-code:0 exec-time:76ms queue-time:0ms
Jan 30 16:08:59 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (79) confirmed on rhel64-1 (rc=0)
Jan 30 16:08:59 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation prmPostgresql_notify_0 (call=54, rc=0, cib-update=0, confirmed=true) ok
Jan 30 16:08:59 rhel64-1 crmd[8143]:   notice: run_graph: Transition 14 (Complete=4, Pending=0, Fired=0, Skipped=26, Incomplete=13, Source=/var/lib/pacemaker/pengine/pe-input-160.bz2): Stopped
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: crm_timer_popped: New Transition Timer (I_PE_CALC) just popped (2000ms)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/108, version=0.37.9)
Jan 30 16:09:01 rhel64-1 pengine[8142]:   notice: unpack_config: On loss of CCM Quorum: Ignore
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: determine_online_status: Node rhel64-1 is online
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: determine_online_status: Node rhel64-2 is online
Jan 30 16:09:01 rhel64-1 pengine[8142]:  warning: unpack_rsc_op_failure: Processing failed op monitor for prmPostgresql:0 on rhel64-1: not running (7)
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: group_print:  Resource Group: master-group
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: native_print:      vip-master#011(ocf::heartbeat:IPaddr2):#011Started rhel64-1 
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: native_print:      vip-rep#011(ocf::heartbeat:IPaddr2):#011Started rhel64-1 
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: clone_print:  Master/Slave Set: msPostgresql [prmPostgresql]
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: native_print:      prmPostgresql#011(ocf::heartbeat:pgsql):#011FAILED Master rhel64-1 
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: short_print:      Slaves: [ rhel64-2 ]
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: clone_print:  Clone Set: clnPingd [prmPingd]
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: short_print:      Started: [ rhel64-1 rhel64-2 ]
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: clone_print:  Clone Set: clnDiskd-Inner [prmDiskd-Inner]
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: short_print:      Started: [ rhel64-1 rhel64-2 ]
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: get_failcount_full: prmPostgresql:0 has failed 1 times on rhel64-1
Jan 30 16:09:01 rhel64-1 pengine[8142]:  warning: common_apply_stickiness: Forcing msPostgresql away from rhel64-1 after 1 failures (max=1)
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: get_failcount_full: prmPostgresql:1 has failed 1 times on rhel64-1
Jan 30 16:09:01 rhel64-1 pengine[8142]:  warning: common_apply_stickiness: Forcing msPostgresql away from rhel64-1 after 1 failures (max=1)
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: native_color: Resource prmPostgresql:0 cannot run anywhere
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: master_color: Promoting prmPostgresql:1 (Slave rhel64-2)
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: master_color: msPostgresql: Promoted 1 instances of a possible 1 to master
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (10s) for vip-master on rhel64-2
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (10s) for vip-rep on rhel64-2
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (9s) for prmPostgresql:1 on rhel64-2
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (9s) for prmPostgresql:1 on rhel64-2
Jan 30 16:09:01 rhel64-1 pengine[8142]:   notice: LogActions: Move    vip-master#011(Started rhel64-1 -> rhel64-2)
Jan 30 16:09:01 rhel64-1 pengine[8142]:   notice: LogActions: Move    vip-rep#011(Started rhel64-1 -> rhel64-2)
Jan 30 16:09:01 rhel64-1 pengine[8142]:   notice: LogActions: Demote  prmPostgresql:0#011(Master -> Stopped rhel64-1)
Jan 30 16:09:01 rhel64-1 pengine[8142]:   notice: LogActions: Promote prmPostgresql:1#011(Slave -> Master rhel64-2)
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPingd:0#011(Started rhel64-1)
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPingd:1#011(Started rhel64-2)
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmDiskd-Inner:0#011(Started rhel64-1)
Jan 30 16:09:01 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmDiskd-Inner:1#011(Started rhel64-2)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Jan 30 16:09:01 rhel64-1 pengine[8142]:   notice: process_pe_message: Calculated Transition 15: /var/lib/pacemaker/pengine/pe-input-161.bz2
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: do_te_invoke: Processing graph 15 (ref=pe_calc-dc-1391065741-118) derived from /var/lib/pacemaker/pengine/pe-input-161.bz2
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 78: notify prmPostgresql_pre_notify_demote_0 on rhel64-1 (local)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: do_lrm_rsc_op: Performing key=78:15:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5 op=prmPostgresql_notify_0
Jan 30 16:09:01 rhel64-1 lrmd[8140]:     info: log_execute: executing - rsc:prmPostgresql action:notify call_id:55
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 80: notify prmPostgresql_pre_notify_demote_0 on rhel64-2
Jan 30 16:09:01 rhel64-1 pacemakerd[16527]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:09:01 rhel64-1 pacemakerd[16527]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:09:01 rhel64-1 pacemakerd[16527]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (80) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:01 rhel64-1 pgsql(prmPostgresql)[16516]: DEBUG: notify: pre for demote
Jan 30 16:09:01 rhel64-1 lrmd[8140]:     info: log_finished: finished - rsc:prmPostgresql action:notify call_id:55 pid:16516 exit-code:0 exec-time:71ms queue-time:0ms
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (78) confirmed on rhel64-1 (rc=0)
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation prmPostgresql_notify_0 (call=55, rc=0, cib-update=0, confirmed=true) ok
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 23: demote prmPostgresql_demote_0 on rhel64-1 (local)
Jan 30 16:09:01 rhel64-1 lrmd[8140]:     info: cancel_recurring_action: Cancelling operation prmPostgresql_monitor_9000
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: do_lrm_rsc_op: Performing key=23:15:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5 op=prmPostgresql_demote_0
Jan 30 16:09:01 rhel64-1 lrmd[8140]:     info: log_execute: executing - rsc:prmPostgresql action:demote call_id:57
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: process_lrm_event: LRM operation prmPostgresql_monitor_9000 (call=43, status=1, cib-update=0, confirmed=true) Cancelled
Jan 30 16:09:01 rhel64-1 pacemakerd[16581]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:09:01 rhel64-1 pacemakerd[16581]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:09:01 rhel64-1 pacemakerd[16581]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] IPC credentials authenticated (8121-16621-28)
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] connecting to client [16621]
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [MAIN  ] connection created
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [CPG   ] lib_init_fn: conn=0x7fa18ab749c0, cpd=0x7fa18a35f6d4
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [CPG   ] cpg finalize for conn=0x7fa18ab749c0
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] HUP conn (8121-16621-28)
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] qb_ipcs_disconnect(8121-16621-28) state:2
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] epoll_ctl(del): Bad file descriptor (9)
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [MAIN  ] cs_ipcs_connection_closed() 
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [CPG   ] exit_fn for conn=0x7fa18ab749c0
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [MAIN  ] cs_ipcs_connection_destroyed() 
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cpg-response-8121-16621-28-header
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cpg-event-8121-16621-28-header
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cpg-request-8121-16621-28-header
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] IPC credentials authenticated (8121-16621-28)
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] connecting to client [16621]
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [MAIN  ] connection created
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [CMAP  ] lib_init_fn: conn=0x7fa18ab749c0
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] HUP conn (8121-16621-28)
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] qb_ipcs_disconnect(8121-16621-28) state:2
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] epoll_ctl(del): Bad file descriptor (9)
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [MAIN  ] cs_ipcs_connection_closed() 
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [CMAP  ] exit_fn for conn=0x7fa18ab749c0
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [MAIN  ] cs_ipcs_connection_destroyed() 
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-8121-16621-28-header
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-8121-16621-28-header
Jan 30 16:09:01 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-8121-16621-28-header
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1de93f0 for uid=0 gid=0 pid=16623 id=ecd30209-61c8-455f-9dd7-999f701763aa
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.9)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=16623 id=5086e343-97a1-4f3e-8ed8-d18f919882a3
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting master-prmPostgresql[rhel64-1] = -INFINITY (writer)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting master-prmPostgresql[rhel64-1]: 1000 -> -INFINITY from rhel64-1
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 52 with 2 changes for master-prmPostgresql, id=<n/a>, set=(null)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=0, node=rhel64-1, tag=nvpair, id=status-3232235791-master-prmPostgresql, name=master-prmPostgresql, value=-INFINITY, magic=NA, cib=0.37.10) : Transient attribute: update
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/52, version=0.37.10)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 52 for master-prmPostgresql: OK (0)
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 52 for master-prmPostgresql[rhel64-1]=-INFINITY: OK (0)
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 52 for master-prmPostgresql[rhel64-2]=100: OK (0)
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1aadfc0 for uid=0 gid=0 pid=16624 id=e455ec1c-2ad5-4d02-a940-880276a198f9
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.10)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=16624 id=7248ba14-787b-4a4c-94df-4cacd641a10c
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting prmPostgresql-master-baseline[rhel64-1] = (null) (writer)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting prmPostgresql-master-baseline[rhel64-1]: 000000000E000000 -> (null) from rhel64-1
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 53 with 2 changes for prmPostgresql-master-baseline, id=<n/a>, set=(null)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:188 - Triggered transition abort (complete=0, node=rhel64-1, tag=transient_attributes, id=3232235791, magic=NA, cib=0.37.11) : Transient attribute: removal
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/53, version=0.37.11)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 53 for prmPostgresql-master-baseline: OK (0)
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 53 for prmPostgresql-master-baseline[rhel64-1]=(null): OK (0)
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 53 for prmPostgresql-master-baseline[rhel64-2]=(null): OK (0)
Jan 30 16:09:01 rhel64-1 pgsql(prmPostgresql)[16570]: ERROR: command failed: su postgres -c cd /dbfp/pgdata/data; kill -s 0 8519 >/dev/null 2>&1
Jan 30 16:09:01 rhel64-1 pgsql(prmPostgresql)[16570]: INFO: PostgreSQL is already stopped on demote.
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df0290 for uid=0 gid=0 pid=16647 id=d435b5c5-bb4c-4e45-838e-9959d1fccb9a
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.11)
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df0290 for uid=0 gid=0 pid=16649 id=e3088043-72b9-4241-a2af-ae8397ce8acb
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.11)
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='3232235791']//transient_attributes//nvpair[@name='prmPostgresql-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.11)
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:01 rhel64-1 pgsql(prmPostgresql)[16570]: INFO: Changing prmPostgresql-status on rhel64-1 : PRI->STOP.
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1df0290 for uid=0 gid=0 pid=16654 id=d38d13d0-2f51-4135-8d87-3d420c27dfaf
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.11)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=16654 id=4cf866ba-ead2-47a9-b116-3fe9ef53ba43
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting prmPostgresql-status[rhel64-1] = STOP (writer)
Jan 30 16:09:01 rhel64-1 lrmd[8140]:     info: log_finished: finished - rsc:prmPostgresql action:demote call_id:57 pid:16570 exit-code:0 exec-time:172ms queue-time:0ms
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation prmPostgresql_demote_0 (call=57, rc=0, cib-update=109, confirmed=true) ok
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting prmPostgresql-status[rhel64-1]: PRI -> STOP from rhel64-1
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 54 with 2 changes for prmPostgresql-status, id=<n/a>, set=(null)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_demote_0 (23) confirmed on rhel64-1 (rc=0)
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 79: notify prmPostgresql_post_notify_demote_0 on rhel64-1 (local)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: do_lrm_rsc_op: Performing key=79:15:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5 op=prmPostgresql_notify_0
Jan 30 16:09:01 rhel64-1 lrmd[8140]:     info: log_execute: executing - rsc:prmPostgresql action:notify call_id:58
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 81: notify prmPostgresql_post_notify_demote_0 on rhel64-2
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/109, version=0.37.12)
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=0, node=rhel64-1, tag=nvpair, id=status-3232235791-prmPostgresql-status, name=prmPostgresql-status, value=STOP, magic=NA, cib=0.37.13) : Transient attribute: update
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/54, version=0.37.13)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 54 for prmPostgresql-status: OK (0)
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 54 for prmPostgresql-status[rhel64-1]=STOP: OK (0)
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 54 for prmPostgresql-status[rhel64-2]=HS:alone: OK (0)
Jan 30 16:09:01 rhel64-1 pacemakerd[16666]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:09:01 rhel64-1 pacemakerd[16666]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:09:01 rhel64-1 pacemakerd[16666]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:09:01 rhel64-1 pgsql(prmPostgresql)[16655]: DEBUG: notify: post for demote
Jan 30 16:09:01 rhel64-1 pgsql(prmPostgresql)[16655]: DEBUG: post-demote called. Demote uname is rhel64-1
Jan 30 16:09:01 rhel64-1 lrmd[8140]:     info: log_finished: finished - rsc:prmPostgresql action:notify call_id:58 pid:16655 exit-code:0 exec-time:77ms queue-time:1ms
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (79) confirmed on rhel64-1 (rc=0)
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation prmPostgresql_notify_0 (call=58, rc=0, cib-update=0, confirmed=true) ok
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting prmPostgresql-master-baseline[rhel64-2]: (null) -> 0000000010000000 from rhel64-2
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 55 with 2 changes for prmPostgresql-master-baseline, id=<n/a>, set=(null)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=0, node=rhel64-2, tag=nvpair, id=status-3232235796-prmPostgresql-master-baseline, name=prmPostgresql-master-baseline, value=0000000010000000, magic=NA, cib=0.37.14) : Transient attribute: update
Jan 30 16:09:01 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/55, version=0.37.14)
Jan 30 16:09:01 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 55 for prmPostgresql-master-baseline: OK (0)
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 55 for prmPostgresql-master-baseline[rhel64-1]=(null): OK (0)
Jan 30 16:09:01 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 55 for prmPostgresql-master-baseline[rhel64-2]=0000000010000000: OK (0)
Jan 30 16:09:01 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (81) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:01 rhel64-1 crmd[8143]:   notice: run_graph: Transition 15 (Complete=11, Pending=0, Fired=0, Skipped=23, Incomplete=8, Source=/var/lib/pacemaker/pengine/pe-input-161.bz2): Stopped
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: crm_timer_popped: New Transition Timer (I_PE_CALC) just popped (2000ms)
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Jan 30 16:09:03 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/110, version=0.37.14)
Jan 30 16:09:03 rhel64-1 pengine[8142]:   notice: unpack_config: On loss of CCM Quorum: Ignore
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: determine_online_status: Node rhel64-1 is online
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: determine_online_status: Node rhel64-2 is online
Jan 30 16:09:03 rhel64-1 pengine[8142]:  warning: unpack_rsc_op_failure: Processing failed op monitor for prmPostgresql:0 on rhel64-1: not running (7)
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: group_print:  Resource Group: master-group
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: native_print:      vip-master#011(ocf::heartbeat:IPaddr2):#011Started rhel64-1 
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: native_print:      vip-rep#011(ocf::heartbeat:IPaddr2):#011Started rhel64-1 
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: clone_print:  Master/Slave Set: msPostgresql [prmPostgresql]
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: native_print:      prmPostgresql#011(ocf::heartbeat:pgsql):#011FAILED rhel64-1 
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: short_print:      Slaves: [ rhel64-2 ]
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: clone_print:  Clone Set: clnPingd [prmPingd]
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: short_print:      Started: [ rhel64-1 rhel64-2 ]
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: clone_print:  Clone Set: clnDiskd-Inner [prmDiskd-Inner]
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: short_print:      Started: [ rhel64-1 rhel64-2 ]
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: get_failcount_full: prmPostgresql:0 has failed 1 times on rhel64-1
Jan 30 16:09:03 rhel64-1 pengine[8142]:  warning: common_apply_stickiness: Forcing msPostgresql away from rhel64-1 after 1 failures (max=1)
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: get_failcount_full: prmPostgresql:1 has failed 1 times on rhel64-1
Jan 30 16:09:03 rhel64-1 pengine[8142]:  warning: common_apply_stickiness: Forcing msPostgresql away from rhel64-1 after 1 failures (max=1)
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: native_color: Resource prmPostgresql:0 cannot run anywhere
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: master_color: Promoting prmPostgresql:1 (Slave rhel64-2)
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: master_color: msPostgresql: Promoted 1 instances of a possible 1 to master
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (10s) for vip-master on rhel64-2
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (10s) for vip-rep on rhel64-2
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (9s) for prmPostgresql:1 on rhel64-2
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (9s) for prmPostgresql:1 on rhel64-2
Jan 30 16:09:03 rhel64-1 pengine[8142]:   notice: LogActions: Move    vip-master#011(Started rhel64-1 -> rhel64-2)
Jan 30 16:09:03 rhel64-1 pengine[8142]:   notice: LogActions: Move    vip-rep#011(Started rhel64-1 -> rhel64-2)
Jan 30 16:09:03 rhel64-1 pengine[8142]:   notice: LogActions: Stop    prmPostgresql:0#011(rhel64-1)
Jan 30 16:09:03 rhel64-1 pengine[8142]:   notice: LogActions: Promote prmPostgresql:1#011(Slave -> Master rhel64-2)
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPingd:0#011(Started rhel64-1)
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPingd:1#011(Started rhel64-2)
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmDiskd-Inner:0#011(Started rhel64-1)
Jan 30 16:09:03 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmDiskd-Inner:1#011(Started rhel64-2)
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: do_te_invoke: Processing graph 16 (ref=pe_calc-dc-1391065743-126) derived from /var/lib/pacemaker/pengine/pe-input-162.bz2
Jan 30 16:09:03 rhel64-1 pengine[8142]:   notice: process_pe_message: Calculated Transition 16: /var/lib/pacemaker/pengine/pe-input-162.bz2
Jan 30 16:09:03 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 15: stop vip-rep_stop_0 on rhel64-1 (local)
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: cancel_recurring_action: Cancelling operation vip-rep_monitor_10000
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: do_lrm_rsc_op: Performing key=15:16:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5 op=vip-rep_stop_0
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: log_execute: executing - rsc:vip-rep action:stop call_id:60
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: process_lrm_event: LRM operation vip-rep_monitor_10000 (call=46, status=1, cib-update=0, confirmed=true) Cancelled
Jan 30 16:09:03 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 71: notify prmPostgresql_pre_notify_stop_0 on rhel64-1 (local)
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: do_lrm_rsc_op: Performing key=71:16:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5 op=prmPostgresql_notify_0
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: log_execute: executing - rsc:prmPostgresql action:notify call_id:61
Jan 30 16:09:03 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 72: notify prmPostgresql_pre_notify_stop_0 on rhel64-2
Jan 30 16:09:03 rhel64-1 pacemakerd[16742]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:09:03 rhel64-1 pacemakerd[16742]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:09:03 rhel64-1 pacemakerd[16742]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (72) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:03 rhel64-1 IPaddr2(vip-rep)[16718]: INFO: IP status = ok, IP_CIP=
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: log_finished: finished - rsc:vip-rep action:stop call_id:60 pid:16718 exit-code:0 exec-time:114ms queue-time:0ms
Jan 30 16:09:03 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation vip-rep_stop_0 (call=60, rc=0, cib-update=111, confirmed=true) ok
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: match_graph_event: Action vip-rep_stop_0 (15) confirmed on rhel64-1 (rc=0)
Jan 30 16:09:03 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 12: stop vip-master_stop_0 on rhel64-1 (local)
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: cancel_recurring_action: Cancelling operation vip-master_monitor_10000
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: do_lrm_rsc_op: Performing key=12:16:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5 op=vip-master_stop_0
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: log_execute: executing - rsc:vip-master action:stop call_id:63
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: process_lrm_event: LRM operation vip-master_monitor_10000 (call=44, status=1, cib-update=0, confirmed=true) Cancelled
Jan 30 16:09:03 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/111, version=0.37.15)
Jan 30 16:09:03 rhel64-1 pgsql(prmPostgresql)[16719]: DEBUG: notify: pre for stop
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: log_finished: finished - rsc:prmPostgresql action:notify call_id:61 pid:16719 exit-code:0 exec-time:151ms queue-time:0ms
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (71) confirmed on rhel64-1 (rc=0)
Jan 30 16:09:03 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation prmPostgresql_notify_0 (call=61, rc=0, cib-update=0, confirmed=true) ok
Jan 30 16:09:03 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 5: stop prmPostgresql_stop_0 on rhel64-1 (local)
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: do_lrm_rsc_op: Performing key=5:16:0:acf9a2a3-307c-460b-b786-fc20e6b8aad5 op=prmPostgresql_stop_0
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: log_execute: executing - rsc:prmPostgresql action:stop call_id:64
Jan 30 16:09:03 rhel64-1 pacemakerd[16856]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Jan 30 16:09:03 rhel64-1 pacemakerd[16856]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Jan 30 16:09:03 rhel64-1 pacemakerd[16856]:     info: crm_xml_cleanup: Cleaning up memory from libxml2
Jan 30 16:09:03 rhel64-1 IPaddr2(vip-master)[16814]: INFO: IP status = ok, IP_CIP=
Jan 30 16:09:03 rhel64-1 lrmd[8140]:     info: log_finished: finished - rsc:vip-master action:stop call_id:63 pid:16814 exit-code:0 exec-time:100ms queue-time:0ms
Jan 30 16:09:03 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation vip-master_stop_0 (call=63, rc=0, cib-update=112, confirmed=true) ok
Jan 30 16:09:03 rhel64-1 crmd[8143]:     info: match_graph_event: Action vip-master_stop_0 (12) confirmed on rhel64-1 (rc=0)
Jan 30 16:09:03 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/112, version=0.37.16)
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] IPC credentials authenticated (8121-16923-28)
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] connecting to client [16923]
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [MAIN  ] connection created
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [CPG   ] lib_init_fn: conn=0x7fa18ab749c0, cpd=0x7fa18a35f6d4
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [CPG   ] cpg finalize for conn=0x7fa18ab749c0
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] HUP conn (8121-16923-28)
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] qb_ipcs_disconnect(8121-16923-28) state:2
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] epoll_ctl(del): Bad file descriptor (9)
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [MAIN  ] cs_ipcs_connection_closed() 
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [CPG   ] exit_fn for conn=0x7fa18ab749c0
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [MAIN  ] cs_ipcs_connection_destroyed() 
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cpg-response-8121-16923-28-header
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cpg-event-8121-16923-28-header
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cpg-request-8121-16923-28-header
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] IPC credentials authenticated (8121-16923-28)
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] connecting to client [16923]
Jan 30 16:09:03 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [QB    ] shm size:1048589; real_size:1052672; rb->word_size:263168
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [MAIN  ] connection created
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [CMAP  ] lib_init_fn: conn=0x7fa18ab749c0
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [QB    ] HUP conn (8121-16923-28)
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [QB    ] qb_ipcs_disconnect(8121-16923-28) state:2
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [QB    ] epoll_ctl(del): Bad file descriptor (9)
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [MAIN  ] cs_ipcs_connection_closed() 
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [CMAP  ] exit_fn for conn=0x7fa18ab749c0
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [MAIN  ] cs_ipcs_connection_destroyed() 
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-8121-16923-28-header
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-8121-16923-28-header
Jan 30 16:09:04 rhel64-1 corosync[8121]:  [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-8121-16923-28-header
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1ac0880 for uid=0 gid=0 pid=16925 id=e092c90f-7080-4257-83ed-7554944321e4
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.16)
Jan 30 16:09:04 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e8dea0 for uid=0 gid=0 pid=16925 id=c5b261ab-812a-4b7c-ac78-bc94d8eb628e
Jan 30 16:09:04 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting master-prmPostgresql[rhel64-1] = -INFINITY (writer)
Jan 30 16:09:04 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1ac0880 for uid=0 gid=0 pid=16926 id=f4ffe340-8b6c-44eb-bd9d-fb8a5ef70eb4
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.16)
Jan 30 16:09:04 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e8dea0 for uid=0 gid=0 pid=16926 id=8719a5c0-46ee-49a0-b851-09ad0b065b7a
Jan 30 16:09:04 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting prmPostgresql-xlog-loc[rhel64-1] = (null) (writer)
Jan 30 16:09:04 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:04 rhel64-1 pgsql(prmPostgresql)[16830]: ERROR: command failed: su postgres -c cd /dbfp/pgdata/data; kill -s 0 8519 >/dev/null 2>&1
Jan 30 16:09:04 rhel64-1 pgsql(prmPostgresql)[16830]: INFO: PostgreSQL is already stopped.
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1ac0880 for uid=0 gid=0 pid=16949 id=ba1a13a6-354f-4a97-9a13-5208b57c7b75
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.37.16)
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: crm_client_new: Connecting 0x1ac0880 for uid=0 gid=0 pid=16951 id=858bda7c-49f7-44c1-86c2-e5549d47edb9
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section nodes: OK (rc=0, origin=local/crm_attribute/2, version=0.37.16)
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section //cib/status//node_state[@id='3232235791']//transient_attributes//nvpair[@name='prmPostgresql-status']: OK (rc=0, origin=local/crm_attribute/3, version=0.37.16)
Jan 30 16:09:04 rhel64-1 lrmd[8140]:     info: log_finished: finished - rsc:prmPostgresql action:stop call_id:64 pid:16830 exit-code:0 exec-time:181ms queue-time:0ms
Jan 30 16:09:04 rhel64-1 crmd[8143]:   notice: process_lrm_event: LRM operation prmPostgresql_stop_0 (call=64, rc=0, cib-update=113, confirmed=true) ok
Jan 30 16:09:04 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_stop_0 (5) confirmed on rhel64-1 (rc=0)
Jan 30 16:09:04 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 73: notify prmPostgresql_post_notify_stop_0 on rhel64-2
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/113, version=0.37.17)
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:04 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (73) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:04 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 74: notify prmPostgresql_pre_notify_promote_0 on rhel64-2
Jan 30 16:09:04 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (74) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:04 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 24: promote prmPostgresql_promote_0 on rhel64-2
Jan 30 16:09:04 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.38.1) : Non-status change
Jan 30 16:09:04 rhel64-1 cib[8138]:   notice: cib:diff: Diff: --- 0.37.17
Jan 30 16:09:04 rhel64-1 cib[8138]:   notice: cib:diff: Diff: +++ 0.38.1 57576db60384dec512a66f394e18d12b
Jan 30 16:09:04 rhel64-1 cib[8138]:   notice: cib:diff: --           <nvpair value="LATEST" id="nodes-3232235791-prmPostgresql-data-status"/>
Jan 30 16:09:04 rhel64-1 cib[8138]:   notice: cib:diff: ++           <nvpair id="nodes-3232235791-prmPostgresql-data-status" name="prmPostgresql-data-status" value="DISCONNECT"/>
Jan 30 16:09:04 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=rhel64-2/crm_attribute/4, version=0.38.1)
Jan 30 16:09:04 rhel64-1 cib[16952]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-51.raw
Jan 30 16:09:04 rhel64-1 cib[16952]:     info: write_cib_contents: Wrote version 0.38.0 of the CIB to disk (digest: 8f05a0f1490f7dd8a19b9d1e523260b0)
Jan 30 16:09:04 rhel64-1 cib[16952]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.o4iLlN (digest: /var/lib/pacemaker/cib/cib.ktVkF4)
Jan 30 16:09:05 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.39.1) : Non-status change
Jan 30 16:09:05 rhel64-1 cib[8138]:   notice: log_cib_diff: cib:diff: Local-only Change: 0.39.1
Jan 30 16:09:05 rhel64-1 cib[8138]:   notice: cib:diff: --           <nvpair value="STREAMING|SYNC" id="nodes-3232235796-prmPostgresql-data-status"/>
Jan 30 16:09:05 rhel64-1 cib[8138]:   notice: cib:diff: ++           <nvpair id="nodes-3232235796-prmPostgresql-data-status" name="prmPostgresql-data-status" value="LATEST"/>
Jan 30 16:09:05 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=rhel64-2/crm_attribute/4, version=0.39.1)
Jan 30 16:09:05 rhel64-1 cib[16960]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-52.raw
Jan 30 16:09:05 rhel64-1 cib[16960]:     info: write_cib_contents: Wrote version 0.39.0 of the CIB to disk (digest: 8c848e4a69dc51152b7945ce49e25b93)
Jan 30 16:09:05 rhel64-1 cib[16960]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.cx5MFl (digest: /var/lib/pacemaker/cib/cib.41INqH)
Jan 30 16:09:05 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting master-prmPostgresql[rhel64-2]: 100 -> 1000 from rhel64-2
Jan 30 16:09:05 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 56 with 2 changes for master-prmPostgresql, id=<n/a>, set=(null)
Jan 30 16:09:05 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=0, node=rhel64-2, tag=nvpair, id=status-3232235796-master-prmPostgresql, name=master-prmPostgresql, value=1000, magic=NA, cib=0.39.2) : Transient attribute: update
Jan 30 16:09:05 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/56, version=0.39.2)
Jan 30 16:09:05 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 56 for master-prmPostgresql: OK (0)
Jan 30 16:09:05 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 56 for master-prmPostgresql[rhel64-1]=-INFINITY: OK (0)
Jan 30 16:09:05 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 56 for master-prmPostgresql[rhel64-2]=1000: OK (0)
Jan 30 16:09:05 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting prmPostgresql-status[rhel64-2]: HS:alone -> PRI from rhel64-2
Jan 30 16:09:05 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 57 with 2 changes for prmPostgresql-status, id=<n/a>, set=(null)
Jan 30 16:09:05 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=0, node=rhel64-2, tag=nvpair, id=status-3232235796-prmPostgresql-status, name=prmPostgresql-status, value=PRI, magic=NA, cib=0.39.3) : Transient attribute: update
Jan 30 16:09:05 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/57, version=0.39.3)
Jan 30 16:09:05 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 57 for prmPostgresql-status: OK (0)
Jan 30 16:09:05 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 57 for prmPostgresql-status[rhel64-1]=STOP: OK (0)
Jan 30 16:09:05 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 57 for prmPostgresql-status[rhel64-2]=PRI: OK (0)
Jan 30 16:09:05 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_promote_0 (24) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:05 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 75: notify prmPostgresql_post_notify_promote_0 on rhel64-2
Jan 30 16:09:05 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=rhel64-2/crmd/22, version=0.39.4)
Jan 30 16:09:06 rhel64-1 attrd[8141]:     info: attrd_peer_update: Setting prmPostgresql-xlog-loc[rhel64-2]: 0000000010000000 -> (null) from rhel64-2
Jan 30 16:09:06 rhel64-1 attrd[8141]:   notice: write_attribute: Sent update 58 with 2 changes for prmPostgresql-xlog-loc, id=<n/a>, set=(null)
Jan 30 16:09:06 rhel64-1 crmd[8143]:     info: abort_transition_graph: te_update_diff:188 - Triggered transition abort (complete=0, node=rhel64-2, tag=transient_attributes, id=3232235796, magic=NA, cib=0.39.5) : Transient attribute: removal
Jan 30 16:09:06 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/58, version=0.39.5)
Jan 30 16:09:06 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_notify_0 (75) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:06 rhel64-1 crmd[8143]:   notice: run_graph: Transition 16 (Complete=24, Pending=0, Fired=0, Skipped=7, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-162.bz2): Stopped
Jan 30 16:09:06 rhel64-1 attrd[8141]:     info: attrd_cib_callback: Update 58 for prmPostgresql-xlog-loc: OK (0)
Jan 30 16:09:06 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 58 for prmPostgresql-xlog-loc[rhel64-1]=(null): OK (0)
Jan 30 16:09:06 rhel64-1 attrd[8141]:   notice: attrd_cib_callback: Update 58 for prmPostgresql-xlog-loc[rhel64-2]=(null): OK (0)
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: crm_timer_popped: New Transition Timer (I_PE_CALC) just popped (2000ms)
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Jan 30 16:09:08 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/114, version=0.39.5)
Jan 30 16:09:08 rhel64-1 pengine[8142]:   notice: unpack_config: On loss of CCM Quorum: Ignore
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: determine_online_status: Node rhel64-1 is online
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: determine_online_status: Node rhel64-2 is online
Jan 30 16:09:08 rhel64-1 pengine[8142]:  warning: unpack_rsc_op_failure: Processing failed op monitor for prmPostgresql:0 on rhel64-1: not running (7)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: group_print:  Resource Group: master-group
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: native_print:      vip-master#011(ocf::heartbeat:IPaddr2):#011Stopped 
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: native_print:      vip-rep#011(ocf::heartbeat:IPaddr2):#011Stopped 
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: clone_print:  Master/Slave Set: msPostgresql [prmPostgresql]
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: short_print:      Masters: [ rhel64-2 ]
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: short_print:      Stopped: [ rhel64-1 ]
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: clone_print:  Clone Set: clnPingd [prmPingd]
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: short_print:      Started: [ rhel64-1 rhel64-2 ]
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: clone_print:  Clone Set: clnDiskd-Inner [prmDiskd-Inner]
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: short_print:      Started: [ rhel64-1 rhel64-2 ]
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: get_failcount_full: prmPostgresql:0 has failed 1 times on rhel64-1
Jan 30 16:09:08 rhel64-1 pengine[8142]:  warning: common_apply_stickiness: Forcing msPostgresql away from rhel64-1 after 1 failures (max=1)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: get_failcount_full: msPostgresql has failed 1 times on rhel64-1
Jan 30 16:09:08 rhel64-1 pengine[8142]:  warning: common_apply_stickiness: Forcing msPostgresql away from rhel64-1 after 1 failures (max=1)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: native_color: Resource prmPostgresql:1 cannot run anywhere
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: master_color: Promoting prmPostgresql:0 (Master rhel64-2)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: master_color: msPostgresql: Promoted 1 instances of a possible 1 to master
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (10s) for vip-master on rhel64-2
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (10s) for vip-rep on rhel64-2
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (9s) for prmPostgresql:0 on rhel64-2
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: RecurringOp:  Start recurring monitor (9s) for prmPostgresql:0 on rhel64-2
Jan 30 16:09:08 rhel64-1 pengine[8142]:   notice: LogActions: Start   vip-master#011(rhel64-2)
Jan 30 16:09:08 rhel64-1 pengine[8142]:   notice: LogActions: Start   vip-rep#011(rhel64-2)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPostgresql:0#011(Master rhel64-2)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPostgresql:1#011(Stopped)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPingd:0#011(Started rhel64-1)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmPingd:1#011(Started rhel64-2)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmDiskd-Inner:0#011(Started rhel64-1)
Jan 30 16:09:08 rhel64-1 pengine[8142]:     info: LogActions: Leave   prmDiskd-Inner:1#011(Started rhel64-2)
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: do_te_invoke: Processing graph 17 (ref=pe_calc-dc-1391065748-137) derived from /var/lib/pacemaker/pengine/pe-input-163.bz2
Jan 30 16:09:08 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 9: start vip-master_start_0 on rhel64-2
Jan 30 16:09:08 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 21: monitor prmPostgresql_monitor_9000 on rhel64-2
Jan 30 16:09:08 rhel64-1 pengine[8142]:   notice: process_pe_message: Calculated Transition 17: /var/lib/pacemaker/pengine/pe-input-163.bz2
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: match_graph_event: Action vip-master_start_0 (9) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:08 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 10: monitor vip-master_monitor_10000 on rhel64-2
Jan 30 16:09:08 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=rhel64-2/crmd/23, version=0.39.6)
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: match_graph_event: Action vip-master_monitor_10000 (10) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:08 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 11: start vip-rep_start_0 on rhel64-2
Jan 30 16:09:08 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=rhel64-2/crmd/24, version=0.39.7)
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: match_graph_event: Action prmPostgresql_monitor_9000 (21) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:08 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=rhel64-2/crmd/25, version=0.39.8)
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: match_graph_event: Action vip-rep_start_0 (11) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:08 rhel64-1 crmd[8143]:   notice: te_rsc_command: Initiating action 12: monitor vip-rep_monitor_10000 on rhel64-2
Jan 30 16:09:08 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=rhel64-2/crmd/26, version=0.39.9)
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: match_graph_event: Action vip-rep_monitor_10000 (12) confirmed on rhel64-2 (rc=0)
Jan 30 16:09:08 rhel64-1 crmd[8143]:   notice: run_graph: Transition 17 (Complete=7, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-163.bz2): Complete
Jan 30 16:09:08 rhel64-1 crmd[8143]:     info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE
Jan 30 16:09:08 rhel64-1 crmd[8143]:   notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Jan 30 16:09:08 rhel64-1 cib[8138]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=rhel64-2/crmd/27, version=0.39.10)
Jan 30 16:09:10 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=16982 id=e228e73f-2dc5-4aff-b3eb-d9f1b738be93
Jan 30 16:09:10 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:09:10 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:09:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:09:22 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17014 id=3d759f95-da2f-4257-a7c1-cb58af5df5db
Jan 30 16:09:22 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:09:22 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:09:34 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17048 id=135f2325-942d-47e9-aaf0-797df2b12f5d
Jan 30 16:09:34 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:09:34 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:09:46 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17086 id=dd17c0b3-98eb-466f-a1f6-a0243a013984
Jan 30 16:09:46 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:09:46 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:09:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:09:58 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17116 id=c04a759c-8992-4d2f-827d-2788b78debfd
Jan 30 16:09:58 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:09:58 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:10:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:10:10 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17149 id=15c6535d-ca04-41df-bf7d-77ca3c10b69d
Jan 30 16:10:10 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:10:10 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:10:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:10:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:10:22 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17181 id=591a144e-4c30-4f00-b10e-2f4a9f0a5b2c
Jan 30 16:10:22 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:10:22 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:10:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:10:34 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17212 id=d1327b56-4d18-4567-91af-49bdefb5131b
Jan 30 16:10:34 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:10:34 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:10:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:10:46 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17252 id=81dd5719-0289-479e-b39f-3537772acf58
Jan 30 16:10:46 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:10:46 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:10:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:10:58 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17282 id=42383361-f742-4dbc-9470-c811d231d0d9
Jan 30 16:10:58 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:10:58 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:11:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:11:10 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17313 id=2cc646ce-62b2-4cd3-9db8-328c08457bfa
Jan 30 16:11:10 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:11:10 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:11:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:11:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:11:22 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17345 id=a4a3d8c4-f257-4241-a4a8-9338cecd2990
Jan 30 16:11:22 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:11:22 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:11:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:11:34 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17376 id=6d04005e-ae66-40aa-b24a-a7b5f8479a14
Jan 30 16:11:34 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:11:34 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:11:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:11:47 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17414 id=58a40fd5-d158-4b38-9474-41cfbadc2234
Jan 30 16:11:47 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:11:47 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:11:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:11:59 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17444 id=9993700b-caab-4124-a401-5dc9809e1fbb
Jan 30 16:11:59 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:11:59 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:12:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:12:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:12:11 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17478 id=941f643e-19cc-44bf-be9b-5abc212a7967
Jan 30 16:12:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:12:11 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:12:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:12:23 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17509 id=bdfd1347-731f-4740-8d5a-ce79c17ed7d7
Jan 30 16:12:23 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:12:23 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:12:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:12:35 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17547 id=1d1d2c4b-7bda-4d81-9c73-a06bcac898c7
Jan 30 16:12:35 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:12:35 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:12:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:12:47 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17578 id=07e18a71-18c3-4f81-a814-b11c1c57a1c0
Jan 30 16:12:47 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:12:47 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:12:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:12:59 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17608 id=fceb37e6-cb05-4bc9-af30-5063a348bd1d
Jan 30 16:12:59 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:12:59 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:13:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:13:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:13:11 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17640 id=c07676cc-5870-4f39-8b87-7eb7fc3a3e3f
Jan 30 16:13:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:13:11 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:13:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:13:23 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17673 id=225bbd5e-70ea-41ef-936b-bdb15d540fbd
Jan 30 16:13:23 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:13:23 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:13:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:13:35 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17711 id=f8734f57-b08e-436b-ab07-d10ff9c795ea
Jan 30 16:13:35 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:13:35 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:13:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:13:47 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17742 id=b3f0a014-9770-44c5-8036-f4f324ade145
Jan 30 16:13:47 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:13:47 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:13:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:13:59 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17772 id=94437576-6831-4a48-9ae3-045b28c23a8b
Jan 30 16:13:59 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:13:59 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:14:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:14:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:14:11 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17804 id=0b16cd5f-f080-4d8c-9ef9-23cf78032c61
Jan 30 16:14:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:14:11 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:14:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:14:23 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17835 id=fc79a94f-190d-4367-9cd8-e7966118f89c
Jan 30 16:14:23 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:14:23 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:14:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:14:35 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17875 id=0f48b85b-f181-4ee1-862f-dba75397669e
Jan 30 16:14:35 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:14:35 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:14:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:14:47 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17906 id=433d3d6d-f093-4df0-b45c-f863735a5cb4
Jan 30 16:14:47 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:14:47 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:14:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:14:59 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17936 id=096cff17-3385-4be3-8d8f-a3fc7f467b18
Jan 30 16:14:59 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:14:59 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:15:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:15:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:15:11 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17968 id=ee811e9d-a5e7-4931-a476-9577ab8996d8
Jan 30 16:15:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:15:11 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:15:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:15:23 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=17999 id=748de044-197f-4fb6-9803-01f3f407bcd4
Jan 30 16:15:23 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:15:23 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:15:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:15:35 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18037 id=af09bc87-c2a8-4774-a62d-72b3d846fdae
Jan 30 16:15:35 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:15:35 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:15:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:15:48 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18069 id=4064acc0-4a04-49d3-aae9-8ab2fd50bbc0
Jan 30 16:15:48 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:15:48 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:15:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:16:00 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18101 id=878c6afd-5a06-49c9-8ab2-c1060343c602
Jan 30 16:16:00 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:16:00 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:16:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:16:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:16:12 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18133 id=39499cf1-8b2c-4821-a91a-df954043fe26
Jan 30 16:16:12 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:16:12 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:16:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:16:24 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18164 id=44c885a4-0147-4dac-a8b4-b12943b58b12
Jan 30 16:16:24 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:16:24 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:16:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:16:36 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18202 id=81a2067f-84e4-4d3c-8118-2899771c2734
Jan 30 16:16:36 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:16:36 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:16:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:16:48 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18232 id=f9556a9c-9924-4ddf-83f2-e45daa585d2f
Jan 30 16:16:48 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:16:48 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:16:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:17:00 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18265 id=67666c8a-dc4d-490b-8ef9-63f278f500d7
Jan 30 16:17:00 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:17:00 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:17:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:17:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:17:12 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18297 id=4d4ad5c3-5545-4c5c-9ba5-462536c077e3
Jan 30 16:17:12 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:17:12 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:17:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:17:24 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18328 id=b68e28d7-ef9c-4d71-afe5-e58f41d39980
Jan 30 16:17:24 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:17:24 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:17:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:17:36 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18366 id=b595d2e0-b8f2-426e-80b0-530e5f6406fc
Jan 30 16:17:36 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:17:36 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:17:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:17:48 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18396 id=5541bb8a-3086-413a-aaa5-1259f65bf6bd
Jan 30 16:17:48 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:17:48 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:17:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:18:00 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18427 id=0e5ad496-0b76-494b-9123-b0f2fd13b767
Jan 30 16:18:00 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:18:00 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:18:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:18:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:18:12 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18459 id=d95504c0-4eb3-4361-b706-dfa0e614ba70
Jan 30 16:18:12 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:18:12 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:18:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:18:24 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18492 id=8f9994c2-09dd-491a-ba06-2d62369150b6
Jan 30 16:18:24 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:18:24 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:18:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:18:36 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18533 id=79daf808-ff15-48aa-a77a-30d78d373f97
Jan 30 16:18:36 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:18:36 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:18:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:18:48 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18563 id=19ad80ce-9140-4244-9795-1f1f8c6f7073
Jan 30 16:18:48 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:18:48 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:18:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:19:00 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18594 id=6dfd1729-be61-4e73-83b5-1cf1ecc181d8
Jan 30 16:19:00 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:19:00 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:19:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:19:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:19:12 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18626 id=66f6f5db-8db4-4c3c-94bd-54353b605101
Jan 30 16:19:12 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:19:12 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:19:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:19:24 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18658 id=6ad31317-b873-4a58-a85b-6473e79b4d1a
Jan 30 16:19:24 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:19:24 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:19:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:19:36 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18698 id=0140af66-ba1d-423a-b4f0-52f0c24474bf
Jan 30 16:19:36 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:19:36 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:19:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:19:49 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18728 id=f66e89ff-6191-4a9a-b05c-c51b472f2069
Jan 30 16:19:49 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:19:49 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:19:51 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:20:01 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18759 id=4e354583-3f83-4f6e-ad7d-193cfe0bdf6b
Jan 30 16:20:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:20:01 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:20:01 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:20:11 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:20:13 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18793 id=48c9b6d5-b0a2-4f30-a2f0-ec8b9c67d417
Jan 30 16:20:13 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:20:13 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:20:21 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:20:25 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18824 id=44e98b88-3c5c-446a-a05f-731052549c09
Jan 30 16:20:25 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:20:25 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:20:31 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
Jan 30 16:20:37 rhel64-1 attrd[8141]:     info: crm_client_new: Connecting 0x1e297f0 for uid=0 gid=0 pid=18864 id=c6250091-8b76-48a9-be15-df0703c4c4b6
Jan 30 16:20:37 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting default_ping_set[rhel64-1] = 100 (writer)
Jan 30 16:20:37 rhel64-1 attrd[8141]:     info: crm_client_destroy: Destroying 0 events
Jan 30 16:20:41 rhel64-1 attrd[8141]:     info: attrd_client_message: Broadcasting diskcheck_status_internal[rhel64-1] = normal (writer)
