No subject
Tue Apr 9 19:27:50 EDT 2013
-------------------------------------------------------
Apr 10 14:12:38 [3391] vsanqa4 crmd: notice:
ais_dispatch_message: Membership 166060: quorum lost
Apr 10 14:12:38 [3386] vsanqa4 cib: notice:
crm_update_peer_state: crm_update_ais_node: Node vsanqa3[1950617772] -
state is now lost
Apr 10 14:12:38 [3391] vsanqa4 crmd: notice:
crm_update_peer_state: crm_update_ais_node: Node vsanqa3[1950617772] -
state is now lost
Apr 10 14:12:38 [3391] vsanqa4 crmd: info:
peer_update_callback: vsanqa3 is now lost (was member)
Apr 10 14:12:38 corosync [CPG ] chosen downlist: sender r(0)
ip(172.16.68.117) ; members(old:2 left:1)
Apr 10 14:12:38 corosync [MAIN ] Completed service synchronization, ready
to provide service.
Apr 10 14:12:38 [3386] vsanqa4 cib: info:
cib_process_request: Operation complete: op cib_modify for section
nodes (origin=local/crmd/62, version=0.668.12): OK (rc=0)
Apr 10 14:12:38 [3386] vsanqa4 cib: info:
cib_process_request: Operation complete: op cib_modify for section
cib (origin=local/crmd/64, version=0.668.14): OK (rc=0)
Apr 10 14:12:38 [3391] vsanqa4 crmd: info:
crmd_ais_dispatch: Setting expected votes to 2
Apr 10 14:12:38 [3386] vsanqa4 cib: info:
cib_process_request: Operation complete: op cib_modify for section
crm_config (origin=local/crmd/66, version=0.668.15): OK (rc=0)
The first six out of the 10 messages above were seen on syslog too. Adding
them here for context. The last four are the "extra" messages in
corosync.log
Pavan
> >
> > Apr 10 14:26:46 vsanqa4 crmd[3391]: notice: do_state_transition: State
> transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED
> origin=crm_timer_popped ]
> > Apr 10 14:26:46 vsanqa4 pengine[3390]: notice: unpack_config: On loss
> of CCM Quorum: Ignore
> > Apr 10 14:26:46 vsanqa4 pengine[3390]: notice: LogActions: Promote
> vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e:0#011(Slave -> Master vsanqa4)
> > Apr 10 14:26:46 vsanqa4 pengine[3390]: notice: process_pe_message:
> Calculated Transition 3: /var/lib/pacemaker/pengine/pe-input-392.bz2
> >
> > Thanks,
> > Pavan
> > _______________________________________________
> > Pacemaker mailing list: Pacemaker at oss.clusterlabs.org
> > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >
> > Project Home: http://www.clusterlabs.org
> > Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
> > Bugs: http://bugs.clusterlabs.org
>
>
> _______________________________________________
> Pacemaker mailing list: Pacemaker at oss.clusterlabs.org
> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
>
> Project Home: http://www.clusterlabs.org
> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
> Bugs: http://bugs.clusterlabs.org
>
--f46d04389107233c4f04da206d4d
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div>Hi Andrew,<br><br></div>Thanks much for looking at th=
is.<br><div><div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quo=
te"><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bor=
der-left:1px solid rgb(204,204,204);padding-left:1ex">
<div><div class=3D"h5">
> Then (after about 15 minutes), I see the following:<br>
<br>
</div></div>There were no logs at all in between?<br></blockquote><div><br>=
</div><div>Absolutely none in the syslog. Only the regular monitor logs fro=
m my resource agent which continued to report as secondary.<br></div><div>
I also checked /var/log/cluster/corosync.log. The only difference between t=
his and the ones in syslog are the messages below:<br></div><div></div><div=
><br></div><div>From /var/log/cluster/corosync.log:<br>--------------------=
-----------------------------------<br>
Apr 10 14:12:38 [3391] vsanqa4=A0=A0=A0=A0=A0=A0 crmd:=A0=A0 notice: ais_di=
spatch_message:=A0=A0=A0=A0=A0 Membership 166060: quorum lost<br>Apr 10 14:=
12:38 [3386] vsanqa4=A0=A0=A0=A0=A0=A0=A0 cib:=A0=A0 notice: crm_update_pee=
r_state:=A0=A0=A0=A0 crm_update_ais_node: Node vsanqa3[1950617772] - state =
is now lost<br>
Apr 10 14:12:38 [3391] vsanqa4=A0=A0=A0=A0=A0=A0 crmd:=A0=A0 notice: crm_up=
date_peer_state:=A0=A0=A0=A0 crm_update_ais_node: Node vsanqa3[1950617772] =
- state is now lost<br>Apr 10 14:12:38 [3391] vsanqa4=A0=A0=A0=A0=A0=A0 crm=
d:=A0=A0=A0=A0 info: peer_update_callback:=A0=A0=A0=A0=A0 vsanqa3 is now lo=
st (was member)<br>
Apr 10 14:12:38 corosync [CPG=A0=A0 ] chosen downlist: sender r(0) ip(172.1=
6.68.117) ; members(old:2 left:1)<br>Apr 10 14:12:38 corosync [MAIN=A0 ] Co=
mpleted service synchronization, ready to provide service.<br><br></div><di=
v>
Apr 10 14:12:38 [3386] vsanqa4=A0=A0=A0=A0=A0=A0=A0 cib:=A0=A0=A0=A0 info: =
cib_process_request:=A0=A0=A0=A0=A0=A0 Operation complete: op cib_modify fo=
r section nodes (origin=3Dlocal/crmd/62, version=3D0.668.12): OK (rc=3D0)<b=
r>Apr 10 14:12:38 [3386] vsanqa4=A0=A0=A0=A0=A0=A0=A0 cib:=A0=A0=A0=A0 info=
: cib_process_request:=A0=A0=A0=A0=A0=A0 Operation complete: op cib_modify =
for section cib (origin=3Dlocal/crmd/64, version=3D0.668.14): OK (rc=3D0)<b=
r>
Apr 10 14:12:38 [3391] vsanqa4=A0=A0=A0=A0=A0=A0 crmd:=A0=A0=A0=A0 info: cr=
md_ais_dispatch:=A0=A0=A0=A0=A0=A0=A0=A0 Setting expected votes to 2<br>Apr=
10 14:12:38 [3386] vsanqa4=A0=A0=A0=A0=A0=A0=A0 cib:=A0=A0=A0=A0 info: cib=
_process_request:=A0=A0=A0=A0=A0=A0 Operation complete: op cib_modify for s=
ection crm_config (origin=3Dlocal/crmd/66, version=3D0.668.15): OK (rc=3D0)=
<br>
<br></div><div>The first six out of the 10 messages above were seen on sysl=
og too. Adding them here for context. The last four are the "extra&quo=
t; messages in corosync.log<br><br></div><div>Pavan<br></div><div></div>
<div><br></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0p=
x 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div class=3D"im"><br>
><br>
> Apr 10 14:26:46 vsanqa4 crmd[3391]: =A0 notice: do_state_transition: S=
tate transition S_IDLE -> S_POLICY_ENGINE [ input=3DI_PE_CALC cause=3DC_=
TIMER_POPPED origin=3Dcrm_timer_popped ]<br>
> Apr 10 14:26:46 vsanqa4 pengine[3390]: =A0 notice: unpack_config: On l=
oss of CCM Quorum: Ignore<br>
> Apr 10 14:26:46 vsanqa4 pengine[3390]: =A0 notice: LogActions: Promote=
vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e:0#011(Slave -> Master vsanqa4)=
<br>
> Apr 10 14:26:46 vsanqa4 pengine[3390]: =A0 notice: process_pe_message:=
Calculated Transition 3: /var/lib/pacemaker/pengine/pe-input-392.bz2<br>
><br>
> Thanks,<br>
> Pavan<br>
</div>> _______________________________________________<br>
> Pacemaker mailing list: <a href=3D"mailto:Pacemaker at oss.clusterlabs.or=
g">Pacemaker at oss.clusterlabs.org</a><br>
> <a href=3D"http://oss.clusterlabs.org/mailman/listinfo/pacemaker" targ=
et=3D"_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
><br>
> Project Home: <a href=3D"http://www.clusterlabs.org" target=3D"_blank"=
>http://www.clusterlabs.org</a><br>
> Getting started: <a href=3D"http://www.clusterlabs.org/doc/Cluster_fro=
m_Scratch.pdf" target=3D"_blank">http://www.clusterlabs.org/doc/Cluster_fro=
m_Scratch.pdf</a><br>
> Bugs: <a href=3D"http://bugs.clusterlabs.org" target=3D"_blank">http:/=
/bugs.clusterlabs.org</a><br>
<br>
<br>
_______________________________________________<br>
Pacemaker mailing list: <a href=3D"mailto:Pacemaker at oss.clusterlabs.org">Pa=
cemaker at oss.clusterlabs.org</a><br>
<a href=3D"http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target=3D=
"_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href=3D"http://www.clusterlabs.org" target=3D"_blank">http=
://www.clusterlabs.org</a><br>
Getting started: <a href=3D"http://www.clusterlabs.org/doc/Cluster_from_Scr=
atch.pdf" target=3D"_blank">http://www.clusterlabs.org/doc/Cluster_from_Scr=
atch.pdf</a><br>
Bugs: <a href=3D"http://bugs.clusterlabs.org" target=3D"_blank">http://bugs=
.clusterlabs.org</a><br>
</blockquote></div><br></div></div></div></div>
--f46d04389107233c4f04da206d4d--
More information about the Pacemaker
mailing list