Apr 27 05:31:04 s2 cib: [16003]: info: apply_xml_diff: Digest mis-match: expected aec9cede658cc6c53ae7998feb1297ca, calculated cfb7c1364874d8f134b7914f193b5f77
Apr 27 05:31:04 s2 cib: [16003]: notice: cib_process_diff: Diff 0.354.46 -> 0.354.47 not applied to 0.354.46: Failed application of an update diff
Apr 27 05:31:04 s2 cib: [16003]: info: cib_server_process_diff: Requesting re-sync from peer
Apr 27 05:31:04 s2 cib: [16003]: notice: cib_server_process_diff: Not applying diff 0.354.46 -> 0.354.47 (sync in progress)
Apr 27 05:31:04 s2 cib: [16003]: info: cib_replace_notify: Replaced: -1.-1.-1 -> 0.354.47 from s1
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-redis-serv-gr:1 (5)
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: last-failure-redis-serv-gr:1 (1335533244)
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: fail-count-redis-serv-gr:1 (2)
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Apr 27 05:31:04 s2 crmd: [16007]: info: config_query_callback: Shutdown escalation occurs after: 1200000ms
Apr 27 05:31:04 s2 crmd: [16007]: info: config_query_callback: Checking for expired actions every 900000ms
Apr 27 05:31:04 s2 crmd: [16007]: info: config_query_callback: Sending expected-votes=2 to corosync
Apr 27 05:31:04 s2 crmd: [16007]: info: ais_dispatch_message: Membership 364: quorum retained
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_ais_dispatch: Update relayed from s1
Apr 27 05:31:04 s2 cib: [16003]: info: apply_xml_diff: Digest mis-match: expected 57ad9849d99fafa83b8c953b2ccdc7e4, calculated a861f2604d59f0bb4c78fed686b13126
Apr 27 05:31:04 s2 cib: [16003]: notice: cib_process_diff: Diff 0.355.8 -> 0.355.9 not applied to 0.355.8: Failed application of an update diff
Apr 27 05:31:04 s2 cib: [16003]: info: cib_server_process_diff: Requesting re-sync from peer
Apr 27 05:31:04 s2 crmd: [16007]: info: delete_resource: Removing resource redis-serv-gr:0 for 27689_crm_resource (internal) on s1
Apr 27 05:31:04 s2 crmd: [16007]: info: notify_deleted: Notifying 27689_crm_resource on s1 that redis-serv-gr:0 was deleted
Apr 27 05:31:04 s2 crmd: [16007]: WARN: decode_transition_key: Bad UUID (crm-resource-27689) in sscanf result (3) for 0:0:crm-resource-27689
Apr 27 05:31:04 s2 crmd: [16007]: info: send_direct_ack: ACK'ing resource op redis-serv-gr:0_delete_60000 from 0:0:crm-resource-27689: lrm_invoke-lrmd-1335533464-10
Apr 27 05:31:04 s2 cib: [16003]: info: cib_replace_notify: Replaced: -1.-1.-1 -> 0.355.8 from s1
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-redis-serv-gr:1 (5)
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: last-failure-redis-serv-gr:1 (1335533244)
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: fail-count-redis-serv-gr:1 (2)
Apr 27 05:31:04 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Apr 27 05:31:05 s2 lrmd: [16004]: info: cancel_op: operation monitor[27] with pid 23500 on redis-serv-gr:1 for client 16007, its parameters: CRM_meta_clone=[1] vservers=[s1test,s2test] CRM_meta_master_node_max=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[2] CRM_meta_notify=[false] CRM_meta_master_max=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.5] masterip=[192.168.1.15] CRM_meta_name=[monitor] CRM_meta_role=[Slave] CRM_meta_interval=[10000] CRM_meta_timeout=[60000]  cancelled
Apr 27 05:31:05 s2 lrmd: [16004]: info: flush_op: process for operation monitor[27] with pid 23500 on redis-serv-gr:1 for client 16007 still running, flush delayed
Apr 27 05:31:05 s2 lrmd: [16004]: info: on_msg_cancel_op: operation 27 running, cancel pending
Apr 27 05:31:05 s2 crmd: [16007]: info: send_direct_ack: ACK'ing resource op redis-serv-gr:1_monitor_10000 from 2:67:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77: lrm_invoke-lrmd-1335533465-11
Apr 27 05:31:05 s2 crm_attribute: [23555]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:31:05 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_10000 (call=27, status=1, cib-update=0, confirmed=true) Cancelled
Apr 27 05:31:05 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=16:68:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_monitor_10000 )
Apr 27 05:31:05 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 monitor[28] (pid 23556)
Apr 27 05:31:05 s2 crm_attribute: [23608]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:31:05 s2 lrmd: [16004]: info: operation monitor[28] on redis-serv-gr:1 for client 16007: pid 23556 exited with return code 0
Apr 27 05:31:05 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_10000 (call=28, rc=0, cib-update=53, confirmed=false) ok
Apr 27 05:31:06 s2 crmd: [16007]: info: config_query_callback: Shutdown escalation occurs after: 1200000ms
Apr 27 05:31:06 s2 crmd: [16007]: info: config_query_callback: Checking for expired actions every 900000ms
Apr 27 05:31:06 s2 crmd: [16007]: info: config_query_callback: Sending expected-votes=2 to corosync
Apr 27 05:31:06 s2 attrd: [16005]: notice: attrd_ais_dispatch: Update relayed from s1
Apr 27 05:31:06 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: fail-count-redis-serv-gr:1 (<null>)
Apr 27 05:31:06 s2 crmd: [16007]: info: ais_dispatch_message: Membership 364: quorum retained
Apr 27 05:31:06 s2 attrd: [16005]: notice: attrd_perform_update: Sent delete 122: node=s2, attr=fail-count-redis-serv-gr:1, id=<n/a>, set=(null), section=status
Apr 27 05:31:06 s2 attrd: [16005]: notice: attrd_perform_update: Sent delete 124: node=s2, attr=fail-count-redis-serv-gr:1, id=<n/a>, set=(null), section=status
Apr 27 05:31:06 s2 cib: [16003]: info: apply_xml_diff: Digest mis-match: expected d7633b4ed3e2da559b02489ad08087d2, calculated 9e75adb30367dc20e0900f3979407e79
Apr 27 05:31:06 s2 cib: [16003]: notice: cib_process_diff: Diff 0.356.2 -> 0.356.3 not applied to 0.356.2: Failed application of an update diff
Apr 27 05:31:06 s2 cib: [16003]: info: cib_server_process_diff: Requesting re-sync from peer
Apr 27 05:31:06 s2 crmd: [16007]: info: delete_resource: Removing resource redis-serv-gr:1 for 27839_crm_resource (internal) on s1
Apr 27 05:31:06 s2 crmd: [16007]: info: lrm_remove_deleted_op: Removing op redis-serv-gr:1_monitor_10000:28 for deleted resource redis-serv-gr:1
Apr 27 05:31:06 s2 crmd: [16007]: info: notify_deleted: Notifying 27839_crm_resource on s1 that redis-serv-gr:1 was deleted
Apr 27 05:31:06 s2 crmd: [16007]: WARN: decode_transition_key: Bad UUID (crm-resource-27839) in sscanf result (3) for 0:0:crm-resource-27839
Apr 27 05:31:06 s2 crmd: [16007]: info: send_direct_ack: ACK'ing resource op redis-serv-gr:1_delete_60000 from 0:0:crm-resource-27839: lrm_invoke-lrmd-1335533466-12
Apr 27 05:31:06 s2 cib: [16003]: notice: cib_server_process_diff: Not applying diff 0.356.2 -> 0.356.3 (sync in progress)
Apr 27 05:31:06 s2 cib: [16003]: notice: cib_server_process_diff: Not applying diff 0.356.3 -> 0.356.4 (sync in progress)
Apr 27 05:31:06 s2 cib: [16003]: info: cib_replace_notify: Replaced: -1.-1.-1 -> 0.356.4 from s1
Apr 27 05:31:06 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-redis-serv-gr:1 (5)
Apr 27 05:31:06 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: last-failure-redis-serv-gr:1 (1335533244)
Apr 27 05:31:06 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Apr 27 05:31:06 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=5:69:7:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_monitor_0 )
Apr 27 05:31:06 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 probe[29] (pid 23611)
Apr 27 05:31:07 s2 crm_attribute: [23663]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:31:07 s2 lrmd: [16004]: info: operation monitor[29] on redis-serv-gr:1 for client 16007: pid 23611 exited with return code 0
Apr 27 05:31:07 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_0 (call=29, rc=0, cib-update=59, confirmed=true) ok
Apr 27 05:31:07 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=16:70:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_monitor_10000 )
Apr 27 05:31:07 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 monitor[30] (pid 23664)
Apr 27 05:31:07 s2 crm_attribute: [23716]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:31:07 s2 lrmd: [16004]: info: operation monitor[30] on redis-serv-gr:1 for client 16007: pid 23664 exited with return code 0
Apr 27 05:31:07 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_10000 (call=30, rc=0, cib-update=60, confirmed=false) ok
Apr 27 05:31:18 s2 crm_attribute: [23769]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:31:23 s2 lrmd: [16004]: info: cancel_op: operation monitor[30] on redis-serv-gr:1 for client 16007, its parameters: CRM_meta_clone=[1] vservers=[s1test,s2test] CRM_meta_master_node_max=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[2] CRM_meta_notify=[false] CRM_meta_master_max=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.5] masterip=[192.168.1.15] CRM_meta_name=[monitor] CRM_meta_role=[Slave] CRM_meta_interval=[10000] CRM_meta_timeout=[60000]  cancelled
Apr 27 05:31:23 s2 crmd: [16007]: info: send_direct_ack: ACK'ing resource op redis-serv-gr:1_monitor_10000 from 3:71:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77: lrm_invoke-lrmd-1335533483-13
Apr 27 05:31:23 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_10000 (call=30, status=1, cib-update=0, confirmed=true) Cancelled
Apr 27 05:31:25 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=11:73:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_promote_0 )
Apr 27 05:31:25 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 promote[31] (pid 23771)
Apr 27 05:31:26 s2 crm_attribute: [23856]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:31:26 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-redis-serv-gr:1 (10)
Apr 27 05:31:26 s2 attrd: [16005]: notice: attrd_perform_update: Sent update 136: master-redis-serv-gr:1=10
Apr 27 05:31:26 s2 lrmd: [16004]: info: operation promote[31] on redis-serv-gr:1 for client 16007: pid 23771 exited with return code 0
Apr 27 05:31:26 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_promote_0 (call=31, rc=0, cib-update=62, confirmed=true) ok
Apr 27 05:31:26 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=5:74:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=ip-redis-gr_start_0 )
Apr 27 05:31:26 s2 lrmd: [16004]: info: rsc:ip-redis-gr start[32] (pid 23857)
Apr 27 05:31:26 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=13:74:8:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_monitor_5000 )
Apr 27 05:31:26 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 monitor[33] (pid 23858)
Apr 27 05:31:26 s2 IPaddr2[23857]: INFO: ip -f inet addr add 192.168.1.15/24 brd 192.168.1.255 dev eth0
Apr 27 05:31:26 s2 IPaddr2[23857]: INFO: ip link set eth0 up
Apr 27 05:31:26 s2 IPaddr2[23857]: INFO: /usr/lib/heartbeat/send_arp -i 200 -r 5 -p /var/run/resource-agents/send_arp-192.168.1.15 eth0 192.168.1.15 auto not_used not_used
Apr 27 05:31:26 s2 lrmd: [16004]: info: operation start[32] on ip-redis-gr for client 16007: pid 23857 exited with return code 0
Apr 27 05:31:26 s2 crmd: [16007]: info: process_lrm_event: LRM operation ip-redis-gr_start_0 (call=32, rc=0, cib-update=63, confirmed=true) ok
Apr 27 05:31:26 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=6:74:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=ip-redis-gr_monitor_10000 )
Apr 27 05:31:26 s2 lrmd: [16004]: info: rsc:ip-redis-gr monitor[34] (pid 23942)
Apr 27 05:31:26 s2 lrmd: [16004]: info: operation monitor[34] on ip-redis-gr for client 16007: pid 23942 exited with return code 0
Apr 27 05:31:26 s2 crmd: [16007]: info: process_lrm_event: LRM operation ip-redis-gr_monitor_10000 (call=34, rc=0, cib-update=64, confirmed=false) ok
Apr 27 05:31:26 s2 crm_attribute: [23988]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:31:26 s2 lrmd: [16004]: info: operation monitor[33] on redis-serv-gr:1 for client 16007: pid 23858 exited with return code 8
Apr 27 05:31:26 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_5000 (call=33, rc=8, cib-update=65, confirmed=false) master
Apr 27 05:31:32 s2 crm_attribute: [24042]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:31:37 s2 crm_attribute: [24123]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:31:42 s2 crm_attribute: [24176]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:31:48 s2 crm_attribute: [24257]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:31:53 s2 crm_attribute: [24310]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:31:59 s2 crm_attribute: [24391]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:04 s2 crm_attribute: [24444]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:10 s2 crm_attribute: [24525]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:15 s2 crm_attribute: [24578]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:20 s2 crm_attribute: [24659]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:26 s2 crm_attribute: [24712]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:31 s2 crm_attribute: [24793]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:36 s2 crm_attribute: [24846]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:42 s2 crm_attribute: [24927]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:47 s2 crm_attribute: [24980]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:52 s2 crm_attribute: [25061]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:32:58 s2 crm_attribute: [25142]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:33:03 s2 crm_attribute: [25195]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:33:08 s2 crm_attribute: [25276]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 10 
Apr 27 05:33:14 s2 crm_attribute: [25361]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -D 
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-redis-serv-gr:1 (<null>)
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_perform_update: Sent delete 139: node=s2, attr=master-redis-serv-gr:1, id=<n/a>, set=(null), section=status
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_perform_update: Sent delete 141: node=s2, attr=master-redis-serv-gr:1, id=<n/a>, set=(null), section=status
Apr 27 05:33:14 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_5000 (call=33, rc=9, cib-update=66, confirmed=false) master (failed)
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_ais_dispatch: Update relayed from s1
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: fail-count-redis-serv-gr:1 (1)
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_perform_update: Sent update 144: fail-count-redis-serv-gr:1=1
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_ais_dispatch: Update relayed from s1
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: last-failure-redis-serv-gr:1 (1335533594)
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_perform_update: Sent update 146: last-failure-redis-serv-gr:1=1335533594
Apr 27 05:33:14 s2 lrmd: [16004]: info: cancel_op: operation monitor[34] on ip-redis-gr for client 16007, its parameters: CRM_meta_name=[monitor] cidr_netmask=[24] crm_feature_set=[3.0.5] CRM_meta_timeout=[30000] CRM_meta_interval=[10000] nic=[eth0] ip=[192.168.1.15]  cancelled
Apr 27 05:33:14 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=9:78:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=ip-redis-gr_stop_0 )
Apr 27 05:33:14 s2 lrmd: [16004]: info: rsc:ip-redis-gr stop[35] (pid 25362)
Apr 27 05:33:14 s2 crmd: [16007]: info: process_lrm_event: LRM operation ip-redis-gr_monitor_10000 (call=34, status=1, cib-update=0, confirmed=true) Cancelled
Apr 27 05:33:14 s2 IPaddr2[25362]: INFO: IP status = ok, IP_CIP=
Apr 27 05:33:14 s2 lrmd: [16004]: info: operation stop[35] on ip-redis-gr for client 16007: pid 25362 exited with return code 0
Apr 27 05:33:14 s2 crmd: [16007]: info: process_lrm_event: LRM operation ip-redis-gr_stop_0 (call=35, rc=0, cib-update=67, confirmed=true) ok
Apr 27 05:33:14 s2 lrmd: [16004]: info: cancel_op: operation monitor[33] on redis-serv-gr:1 for client 16007, its parameters: CRM_meta_clone=[1] vservers=[s1test,s2test] CRM_meta_master_node_max=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[2] CRM_meta_notify=[false] CRM_meta_master_max=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.5] masterip=[192.168.1.15] CRM_meta_name=[monitor] CRM_meta_role=[Master] CRM_meta_interval=[5000] CRM_meta_timeout=[60000]  cancelled
Apr 27 05:33:14 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=17:78:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_demote_0 )
Apr 27 05:33:14 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 demote[36] (pid 25397)
Apr 27 05:33:14 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_5000 (call=33, status=1, cib-update=0, confirmed=true) Cancelled
Apr 27 05:33:14 s2 lrmd: [16004]: info: operation demote[36] on redis-serv-gr:1 for client 16007: pid 25397 exited with return code 7
Apr 27 05:33:14 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_demote_0 (call=36, rc=7, cib-update=68, confirmed=true) not running
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_ais_dispatch: Update relayed from s1
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: fail-count-redis-serv-gr:1 (2)
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_perform_update: Sent update 148: fail-count-redis-serv-gr:1=2
Apr 27 05:33:14 s2 attrd: [16005]: notice: attrd_ais_dispatch: Update relayed from s1
Apr 27 05:33:14 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=2:80:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_stop_0 )
Apr 27 05:33:14 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 stop[37] (pid 25437)
Apr 27 05:33:14 s2 crm_attribute: [25442]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -D 
Apr 27 05:33:15 s2 lrmd: [16004]: info: operation stop[37] on redis-serv-gr:1 for client 16007: pid 25437 exited with return code 0
Apr 27 05:33:15 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_stop_0 (call=37, rc=0, cib-update=69, confirmed=true) ok
Apr 27 05:33:16 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=12:81:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_start_0 )
Apr 27 05:33:16 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 start[38] (pid 25484)
Apr 27 05:33:17 s2 crm_attribute: [25610]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:33:17 s2 attrd: [16005]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-redis-serv-gr:1 (5)
Apr 27 05:33:17 s2 attrd: [16005]: notice: attrd_perform_update: Sent update 152: master-redis-serv-gr:1=5
Apr 27 05:33:17 s2 lrmd: [16004]: info: operation start[38] on redis-serv-gr:1 for client 16007: pid 25484 exited with return code 0
Apr 27 05:33:17 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_start_0 (call=38, rc=0, cib-update=70, confirmed=true) ok
Apr 27 05:33:17 s2 crmd: [16007]: info: do_lrm_rsc_op: Performing key=16:82:0:b63cb1ed-d42c-456e-b4b0-3c5da4b81a77 op=redis-serv-gr:1_monitor_10000 )
Apr 27 05:33:17 s2 lrmd: [16004]: info: rsc:redis-serv-gr:1 monitor[39] (pid 25615)
Apr 27 05:33:18 s2 crm_attribute: [25667]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:33:18 s2 lrmd: [16004]: info: operation monitor[39] on redis-serv-gr:1 for client 16007: pid 25615 exited with return code 0
Apr 27 05:33:18 s2 crmd: [16007]: info: process_lrm_event: LRM operation redis-serv-gr:1_monitor_10000 (call=39, rc=0, cib-update=71, confirmed=false) ok
Apr 27 05:33:28 s2 crm_attribute: [25720]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:33:38 s2 crm_attribute: [25773]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:33:49 s2 crm_attribute: [25826]: info: Invoked: crm_attribute -N s2 -n master-redis-serv-gr:1 -l reboot -v 5 
Apr 27 05:33:55 s2 logger: Mark:HB_REPORT:1335533633
