[Pacemaker] Cannot get "order" constraint to work.
Dejan Muhamedagic
dejanmm at fastmail.fm
Wed Oct 14 11:37:13 EDT 2009
Hi,
On Wed, Oct 14, 2009 at 06:20:42PM +0300, Stratos Zolotas wrote:
> Something new!!!!!
>
> After cleaning everything, and started from scratch. I'm up an running (some
> sort).
Really glad to hear that you're making progress.
> I'm getting this on the logs and drbd does no start:
>
> Oct 14 18:13:52 alpha pengine: [24657]: info: unpack_rsc_op:
> drbd_mysql:0_monitor_0 on alpha returned 5 (not installed) instead of the
> expected value: 7 (not running)
You should check the errors reported by the resource agent.
Search for lrmd.*drbd in the logs. There's also excellent
documentation by linbit on running drbd in a cluster. Your
cluster functions now, you just need to fix the resources.
Thanks,
Dejan
> Oct 14 18:13:52 alpha pengine: [24657]: ERROR: unpack_rsc_op: Hard error -
> drbd_mysql:0_monitor_0 failed with rc=5: Preventing ms_drbd_mysql from
> re-starting on alpha
> Oct 14 18:13:52 alpha pengine: [24657]: info: determine_online_status: Node
> bravo is online
> Oct 14 18:13:52 alpha pengine: [24657]: info: unpack_rsc_op:
> drbd_mysql:1_monitor_0 on bravo returned 5 (not installed) instead of the
> expected value: 7 (not running)
> Oct 14 18:13:52 alpha pengine: [24657]: ERROR: unpack_rsc_op: Hard error -
> drbd_mysql:1_monitor_0 failed with rc=5: Preventing ms_drbd_mysql from
> re-starting on bravo
> Oct 14 18:13:52 alpha pengine: [24657]: notice: group_print: Resource Group:
> mysql
> Oct 14 18:13:52 alpha pengine: [24657]: notice: native_print:
> fs_mysql (ocf::heartbeat:Filesystem):
> Stopped
>
> Oct 14 18:13:52 alpha pengine: [24657]: notice: native_print:
> ip_mysql (ocf::heartbeat:IPaddr2):
> Stopped
>
> Oct 14 18:13:52 alpha pengine: [24657]: notice: native_print:
> mysqld (lsb:mysql):
> Stopped
>
> Oct 14 18:13:52 alpha pengine: [24657]: notice: native_print:
> apache (lsb:apache2):
> Stopped
>
> Oct 14 18:13:52 alpha pengine: [24657]: notice: clone_print: Master/Slave
> Set: ms_drbd_mysql
> Oct 14 18:13:52 alpha pengine: [24657]: notice: print_list: Stopped: [
> drbd_mysql:0 drbd_mysql:1 ]
> Oct 14 18:13:52 alpha pengine: [24657]: info: native_merge_weights:
> ms_drbd_mysql: Rolling back scores from
> fs_mysql
>
> Oct 14 18:13:52 alpha pengine: [24657]: WARN: native_color: Resource
> drbd_mysql:0 cannot run anywhere
> Oct 14 18:13:52 alpha pengine: [24657]: WARN: native_color: Resource
> drbd_mysql:1 cannot run anywhere
> Oct 14 18:13:52 alpha pengine: [24657]: info: native_merge_weights:
> ms_drbd_mysql: Rolling back scores from
> fs_mysql
>
> Oct 14 18:13:52 alpha pengine: [24657]: info: master_color: ms_drbd_mysql:
> Promoted 0 instances of a possible 1 to
> master
>
> Oct 14 18:13:52 alpha pengine: [24657]: info: native_merge_weights:
> fs_mysql: Rolling back scores from
> ip_mysql
>
> Oct 14 18:13:52 alpha pengine: [24657]: WARN: native_color: Resource
> fs_mysql cannot run anywhere
>
>
> Check the first line (i think it says something), should be "not running"
> but it is "not installed".
>
> Maybe this is the problem.
>
> Thanks again. At least i'm learning and it seems now i'm getting somewhere.
>
> Also order constraint is accepted. I still have no running cluster but it is
> a big difference from previous attempts!!!!
>
> Stratos.
>
> On Wed, Oct 14, 2009 at 5:36 PM, Dejan Muhamedagic <dejanmm at fastmail.fm>wrote:
>
> > Hi,
> >
> > On Wed, Oct 14, 2009 at 05:31:09PM +0300, Stratos Zolotas wrote:
> > > If i change pacemaker version to "1" from "0" in the openais.conf,
> > openais
> > > is started without errors, but the crm cannot connect to cluster.
> > >
> > > Which is the difference between "1" and "0" on the "ver" parameter of
> > > pacemaker in the openais.con?
> > >
> > > Does this mean something? (that openais starts ok).
> >
> > Don't know, I've always used only ver: 0.
> >
> > Anyway, if you can't figure out what's going on, please try to
> > use hb_report and file a bugzilla.
> >
> > Thanks,
> >
> > Dejan
> >
> > > On Wed, Oct 14, 2009 at 5:24 PM, Stratos Zolotas <strzol at gmail.com>
> > wrote:
> > >
> > > > Hi,
> > > >
> > > > cores are empty
> > > >
> > > > I think i'm on dead end......
> > > >
> > > > Thanks.
> > > >
> > > >
> > > > On Wed, Oct 14, 2009 at 5:02 PM, Dejan Muhamedagic <
> > dejanmm at fastmail.fm>wrote:
> > > >
> > > >> Hi,
> > > >>
> > > >> On Wed, Oct 14, 2009 at 04:39:05PM +0300, Stratos Zolotas wrote:
> > > >> > Ok, I have installed latest version of pacemaker (1.0.5) from
> > opensuse
> > > >> > ha-clustering repo, but it is not working.
> > > >> >
> > > >> > I'm starting openais on the alpha node and i get a lot of messages.
> > On
> > > >> the
> > > >> > bravo node openais fails to start.
> > > >> >
> > > >> > The same happens if i start the bravo node first, the on alpha it
> > fails.
> > > >> >
> > > >> > Attached is my log. At least it doesn't segfault!
> > > >> >
> > > >> > I'm starting to get tired. And with pacamaker 1.0.1 my only problem
> > was
> > > >> the
> > > >> > order constraint.
> > > >> >
> > > >> > I have also cleared all the configurations (cib.xml and others in
> > > >> > /var/lib/heartbeat/crm) to start from scratch without success.
> > > >> >
> > > >> > Any help is appreciated. I'm feeling lost.
> > > >>
> > > >> Hmpf. All pacemaker processes start but leave without trace soon:
> > > >>
> > > >> Oct 14 16:22:44 alpha cib: [18888]: info: startCib: CIB Initialization
> > > >> completed successfully
> > > >> Oct 14 16:22:44 alpha cib: [18888]: info: crm_cluster_connect:
> > Connecting
> > > >> to OpenAIS
> > > >> Oct 14 16:22:44 alpha cib: [18888]: info: init_ais_connection:
> > Creating
> > > >> connection to our AIS plugin
> > > >>
> > > >> That's the last we hear from cib. Unfortunately that's too little
> > > >> to work on. Maybe they are segfaulting. Can you please check
> > > >> again /var/lib/heartbeat/cores
> > > >>
> > > >> Perhaps somebody else has an idea on what's going on.
> > > >>
> > > >> THanks,
> > > >>
> > > >> Dejan
> > > >>
> > > >> > Thanks in advance.
> > > >> >
> > > >> > On Wed, Oct 14, 2009 at 3:21 PM, Stratos Zolotas <strzol at gmail.com>
> > > >> wrote:
> > > >> >
> > > >> > > When i try to install pacemaker-1.0.5-4.1.x86_64 the system
> > (opensuse
> > > >> 11.1
> > > >> > > x86_64) asks to downgrade heartbeat-common-2.99.3-1.6.x86_64 to
> > > >> > > cluster-glue-1.0-12.1.x86_64.
> > > >> > >
> > > >> > > Is this ok and normal?
> > > >> > >
> > > >> > >
> > > >> > > On Wed, Oct 14, 2009 at 3:09 PM, Stratos Zolotas <
> > strzol at gmail.com>
> > > >> wrote:
> > > >> > >
> > > >> > >> If you remember with the upgraded version pacemaker 1.0.5, i'm
> > > >> getting
> > > >> > >> segfaults on crmd.
> > > >> > >>
> > > >> > >> I will try it again. From which repo should i upgrade?
> > > >> > >>
> > > >> > >> Thanks.
> > > >> > >>
> > > >> > >>
> > > >> > >> On Wed, Oct 14, 2009 at 3:06 PM, Dejan Muhamedagic <
> > > >> dejanmm at fastmail.fm>wrote:
> > > >> > >>
> > > >> > >>> Hi,
> > > >> > >>>
> > > >> > >>> On Wed, Oct 14, 2009 at 01:47:08PM +0300, Stratos Zolotas wrote:
> > > >> > >>> > Hi,
> > > >> > >>> >
> > > >> > >>> > all the packages are from the opensuse standard repos.
> > > >> > >>> >
> > > >> > >>> > alpha:/ # /usr/lib64/heartbeat/crmd version
> > > >> > >>> > CRM Version: 1.0.1 (node:
> > > >> 27be064e090742359bbdd1914f9d7dd363c8e0d8)
> > > >> > >>> > alpha:/ #
> > > >> > >>>
> > > >> > >>> That's fairly old. Can you please upgrade.
> > > >> > >>>
> > > >> > >>> Thanks,
> > > >> > >>>
> > > >> > >>> Dejan
> > > >> > >>>
> > > >> > >>> > Thanks.
> > > >> > >>> >
> > > >> > >>> > On Wed, Oct 14, 2009 at 1:44 PM, Dejan Muhamedagic <
> > > >> > >>> dejanmm at fastmail.fm>wrote:
> > > >> > >>> >
> > > >> > >>> > > Hi,
> > > >> > >>> > >
> > > >> > >>> > > On Wed, Oct 14, 2009 at 01:30:32PM +0300, Stratos Zolotas
> > wrote:
> > > >> > >>> > > > order mysql_after_drbd inf: ms_drbd_mysql:promote
> > mysql:start
> > > >> > >>> > > >
> > > >> > >>> > > > is committed ok, but it doesn't show right in the
> > > >> configuration:
> > > >> > >>> > > >
> > > >> > >>> > > > primitive fs_mysql ocf:heartbeat:Filesystem \
> > > >> > >>> > > > params device="/dev/drbd0" directory="/service/"
> > > >> > >>> fstype="ext3"
> > > >> > >>> > > > primitive ip_mysql ocf:heartbeat:IPaddr2 \
> > > >> > >>> > > > params ip="192.168.1.72" nic="eth2:0"
> > > >> > >>> > > > primitive mysqld lsb:mysql
> > > >> > >>> > > > primitive apache lsb:apache2
> > > >> > >>> > > > primitive drbd_mysql ocf:linbit:drbd \
> > > >> > >>> > > > params drbd_resource="r0" \
> > > >> > >>> > > > operations $id="drbd_mysql-ops" \
> > > >> > >>> > > > op monitor interval="15s"
> > > >> > >>> > > > group mysql fs_mysql ip_mysql mysqld apache
> > > >> > >>> > > > ms ms_drbd_mysql drbd_mysql \
> > > >> > >>> > > > meta master-max="1" master-node-max="1"
> > clone-max="2"
> > > >> > >>> > > > clone-node-max="1" notify="true"
> > > >> > >>> > > > colocation mysql_on_drbd INFINITY: mysql
> > ms_drbd_mysql:Master
> > > >> > >>> > > > order mysql_after_drbd INFINITY:
> > > >> > >>> > >
> > > >> > >>> > > Funny. I've never seen this :)
> > > >> > >>> > >
> > > >> > >>> > > > property $id="cib-bootstrap-options" \
> > > >> > >>> > > > dc-version="1.0.1-node:
> > > >> > >>> 27be064e090742359bbdd1914f9d7dd363c8e0d8"
> > > >> > >>> > > \
> > > >> > >>> > >
> > > >> > >>> > > Which version do you run? See with /usr/lib/heartbeat/crmd
> > > >> version.
> > > >> > >>> > >
> > > >> > >>> > > Thanks,
> > > >> > >>> > >
> > > >> > >>> > > Dejan
> > > >> > >>> > >
> > > >> > >>> > > > no-quorum-policy="ignore" \
> > > >> > >>> > > > stonith-enabled="false" \
> > > >> > >>> > > > default-resource-stickiness="1000"
> > > >> > >>> > > >
> > > >> > >>> > > > And if i exit crm and enter again i get:
> > > >> > >>> > > >
> > > >> > >>> > > > alpha:/ # crm
> > > >> > >>> > > > crm(live)# configure
> > > >> > >>> > > > ERROR: syntax : order mysql_after_drbd INFINITY:
> > > >> > >>> > > > crm(live)configure# show
> > > >> > >>> > > > ERROR: object mysql_after_drbd cannot be represented in
> > the
> > > >> CLI
> > > >> > >>> notation
> > > >> > >>> > > > crm(live)configure#
> > > >> > >>> > > >
> > > >> > >>> > > > I'm attaching my log.
> > > >> > >>> > > >
> > > >> > >>> > > > Thanks.
> > > >> > >>> > > >
> > > >> > >>> > > > On Wed, Oct 14, 2009 at 1:21 PM, Dejan Muhamedagic <
> > > >> > >>> dejanmm at fastmail.fm
> > > >> > >>> > > >wrote:
> > > >> > >>> > > >
> > > >> > >>> > > > > Hi,
> > > >> > >>> > > > >
> > > >> > >>> > > > > On Wed, Oct 14, 2009 at 12:13:42PM +0200, Johan Verrept
> > > >> wrote:
> > > >> > >>> > > > > > Sorry, I missed that. Was already wondering why the
> > error
> > > >> was
> > > >> > >>> so
> > > >> > >>> > > > > > cryptic.
> > > >> > >>> > > > > >
> > > >> > >>> > > > > > It is definatly possible, I use it myself:
> > > >> > >>> > > > > >
> > > >> > >>> > > > > > order drbd-before-master-group inf: ms-drbd0:promote
> > > >> > >>> > > master-group:start
> > > >> > >>> > > > > >
> > > >> > >>> > > > > > And master-group is a group with 3 primitives.
> > > >> > >>> > > > > >
> > > >> > >>> > > > > > Maybe try the inf: instead of the mandatory: ?
> > > >> > >>> > > > >
> > > >> > >>> > > > > Maybe, that's equal, though mandatory should work fine
> > as
> > > >> well.
> > > >> > >>> > > > >
> > > >> > >>> > > > > The only way to figure out what's going on is to take a
> > look
> > > >> at
> > > >> > >>> > > > > the logs.
> > > >> > >>> > > > >
> > > >> > >>> > > > > Thanks,
> > > >> > >>> > > > >
> > > >> > >>> > > > > Dejan
> > > >> > >>> > > > >
> > > >> > >>> > > > > > FYI, I am on pacemaker 1.0.5.
> > > >> > >>> > > > > >
> > > >> > >>> > > > > > J.
> > > >> > >>> > > > > >
> > > >> > >>> > > > > > On Wed, 2009-10-14 at 13:11 +0300, Stratos Zolotas
> > wrote:
> > > >> > >>> > > > > > > As you can see in the config, I have a group named
> > mysql
> > > >> that
> > > >> > >>> > > includes
> > > >> > >>> > > > > > > fs_mysql, ip_mysql, mysqld, apache primitives.
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > The expecting result is to start this group after
> > > >> > >>> ms_drbd_mysql is
> > > >> > >>> > > > > > > promoted to one of the nodes.
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > Is this wrong? Should I try a different approach?
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > Stratos.
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > On Wed, Oct 14, 2009 at 1:02 PM, Johan Verrept <
> > > >> > >>> > > Johan.Verrept at able.be>
> > > >> > >>> > > > > > > wrote:
> > > >> > >>> > > > > > > I don't know if it is your only problem but
> > in
> > > >> the
> > > >> > >>> order
> > > >> > >>> > > you
> > > >> > >>> > > > > > > refer to
> > > >> > >>> > > > > > > primitive "mysql" while in your
> > configuration
> > > >> you
> > > >> > >>> have
> > > >> > >>> > > > > > > primitive
> > > >> > >>> > > > > > > "mysqld". Note the "d".
> > > >> > >>> > > > > > > Other than that, the order constraint looks
> > like
> > > >> > >>> mine.
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > J.
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > On Wed, 2009-10-14 at 12:59 +0300, Stratos
> > > >> Zolotas
> > > >> > >>> wrote:
> > > >> > >>> > > > > > > > Hello again.
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > After struggling with the latest versions,
> > i
> > > >> > >>> decided to
> > > >> > >>> > > try
> > > >> > >>> > > > > > > with the
> > > >> > >>> > > > > > > > versions in the standard opesuse repos,
> > that
> > > >> means:
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > openais 0.80.3
> > > >> > >>> > > > > > > > libopenais2 0.80.3
> > > >> > >>> > > > > > > > pacemaker 1.0.1
> > > >> > >>> > > > > > > > libpacemaker3 1.0.1
> > > >> > >>> > > > > > > > heartbeat 2.99.3
> > > >> > >>> > > > > > > > heartbeat-common 2.99.3
> > > >> > >>> > > > > > > > heartbeat-resources 2.99.3
> > > >> > >>> > > > > > > > libheartbeat2 2.99.3
> > > >> > >>> > > > > > > > OpenIPMI 2.0.14
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > It seems to work ok, the nodes are
> > > >> communicating
> > > >> > >>> and i
> > > >> > >>> > > can
> > > >> > >>> > > > > > > connect to
> > > >> > >>> > > > > > > > cib and create configuration, but i cannot
> > > >> > >>> configure an
> > > >> > >>> > > > > > > order
> > > >> > >>> > > > > > > > constraint in the configuration file.
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > I try this:
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > order mysql_after_drbd mandatory:
> > > >> > >>> ms_drbd_mysql:promote
> > > >> > >>> > > > > > > mysql:start
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > But when i try to commit i get:
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > Call cib_create failed (-47): Update does
> > not
> > > >> > >>> conform to
> > > >> > >>> > > the
> > > >> > >>> > > > > > > > configured schema/DTD
> > > >> > >>> > > > > > > > <null>
> > > >> > >>> > > > > > > > ERROR: could not create mysql_after_drbd
> > > >> > >>> > > > > > > > offending xml: <rsc_order
> > > >> first="ms_drbd_mysql"
> > > >> > >>> > > > > > > first-action="promote"
> > > >> > >>> > > > > > > > id="mysql_after_drbd" score="inf"
> > then="mysql"
> > > >> > >>> > > > > > > then-action="start"/>
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > Am I doing something wrong?
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > The rest of the configuration is accepted
> > and
> > > >> is:
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > primitive fs_mysql
> > ocf:heartbeat:Filesystem \
> > > >> > >>> > > > > > > > params device="/dev/drbd0"
> > > >> > >>> directory="/service/"
> > > >> > >>> > > > > > > fstype="ext3"
> > > >> > >>> > > > > > > > primitive ip_mysql ocf:heartbeat:IPaddr2 \
> > > >> > >>> > > > > > > > params ip="192.168.1.72"
> > nic="eth2:0"
> > > >> > >>> > > > > > > > primitive mysqld lsb:mysql
> > > >> > >>> > > > > > > > primitive apache lsb:apache2
> > > >> > >>> > > > > > > > primitive drbd_mysql ocf:linbit:drbd \
> > > >> > >>> > > > > > > > params drbd_resource="r0" \
> > > >> > >>> > > > > > > > operations $id="drbd_mysql-ops" \
> > > >> > >>> > > > > > > > op monitor interval="15s"
> > > >> > >>> > > > > > > > group mysql fs_mysql ip_mysql mysqld
> > apache
> > > >> > >>> > > > > > > > ms ms_drbd_mysql drbd_mysql \
> > > >> > >>> > > > > > > > meta master-max="1"
> > > >> master-node-max="1"
> > > >> > >>> > > > > > > clone-max="2"
> > > >> > >>> > > > > > > > clone-node-max="1" notify="true"
> > > >> > >>> > > > > > > > colocation mysql_on_drbd INFINITY: mysql
> > > >> > >>> > > > > > > ms_drbd_mysql:Master
> > > >> > >>> > > > > > > > property $id="cib-bootstrap-options" \
> > > >> > >>> > > > > > > > dc-version="1.0.1-node:
> > > >> > >>> > > > > > > > 27be064e090742359bbdd1914f9d7dd363c8e0d8"
> > \
> > > >> > >>> > > > > > > > no-quorum-policy="ignore" \
> > > >> > >>> > > > > > > > stonith-enabled="false" \
> > > >> > >>> > > > > > > > default-resource-stickiness="1000"
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > Thanks in advance
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > > > Stratos.
> > > >> > >>> > > > > > > >
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > >
> > > >> _______________________________________________
> > > >> > >>> > > > > > > > Pacemaker mailing list
> > > >> > >>> > > > > > > > Pacemaker at oss.clusterlabs.org
> > > >> > >>> > > > > > > >
> > > >> > >>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > >
> > _______________________________________________
> > > >> > >>> > > > > > > Pacemaker mailing list
> > > >> > >>> > > > > > > Pacemaker at oss.clusterlabs.org
> > > >> > >>> > > > > > >
> > > >> > >>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > --
> > > >> > >>> > > > > > > Kernel IT Solutions Ltd
> > > >> > >>> > > > > > > http://www.kernelit.gr
> > > >> > >>> > > > > > >
> > > >> > >>> > > > > > > Cyclades Wireless Network
> > > >> > >>> > > > > > > http://www.cywn.gr
> > > >> > >>> > > > > > > _______________________________________________
> > > >> > >>> > > > > > > Pacemaker mailing list
> > > >> > >>> > > > > > > Pacemaker at oss.clusterlabs.org
> > > >> > >>> > > > > > >
> > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>> > > > > >
> > > >> > >>> > > > > >
> > > >> > >>> > > > > > _______________________________________________
> > > >> > >>> > > > > > Pacemaker mailing list
> > > >> > >>> > > > > > Pacemaker at oss.clusterlabs.org
> > > >> > >>> > > > > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>> > > > >
> > > >> > >>> > > > > _______________________________________________
> > > >> > >>> > > > > Pacemaker mailing list
> > > >> > >>> > > > > Pacemaker at oss.clusterlabs.org
> > > >> > >>> > > > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>> > > > >
> > > >> > >>> > > >
> > > >> > >>> > > >
> > > >> > >>> > > >
> > > >> > >>> > > > --
> > > >> > >>> > > > Kernel IT Solutions Ltd
> > > >> > >>> > > > http://www.kernelit.gr
> > > >> > >>> > > >
> > > >> > >>> > > > Cyclades Wireless Network
> > > >> > >>> > > > http://www.cywn.gr
> > > >> > >>> > >
> > > >> > >>> > >
> > > >> > >>> > > > _______________________________________________
> > > >> > >>> > > > Pacemaker mailing list
> > > >> > >>> > > > Pacemaker at oss.clusterlabs.org
> > > >> > >>> > > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>> > >
> > > >> > >>> > >
> > > >> > >>> > > _______________________________________________
> > > >> > >>> > > Pacemaker mailing list
> > > >> > >>> > > Pacemaker at oss.clusterlabs.org
> > > >> > >>> > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>> > >
> > > >> > >>>
> > > >> > >>> > _______________________________________________
> > > >> > >>> > Pacemaker mailing list
> > > >> > >>> > Pacemaker at oss.clusterlabs.org
> > > >> > >>> > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>>
> > > >> > >>>
> > > >> > >>> _______________________________________________
> > > >> > >>> Pacemaker mailing list
> > > >> > >>> Pacemaker at oss.clusterlabs.org
> > > >> > >>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >> > >>>
> > > >> > >>
> > > >> > >>
> > > >> > >
> > > >>
> > > >>
> > > >> > _______________________________________________
> > > >> > Pacemaker mailing list
> > > >> > Pacemaker at oss.clusterlabs.org
> > > >> > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >>
> > > >>
> > > >> _______________________________________________
> > > >> Pacemaker mailing list
> > > >> Pacemaker at oss.clusterlabs.org
> > > >> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> > > >>
> > > >
> > > >
> >
> > > _______________________________________________
> > > Pacemaker mailing list
> > > Pacemaker at oss.clusterlabs.org
> > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >
> >
> > _______________________________________________
> > Pacemaker mailing list
> > Pacemaker at oss.clusterlabs.org
> > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >
> _______________________________________________
> Pacemaker mailing list
> Pacemaker at oss.clusterlabs.org
> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
More information about the Pacemaker
mailing list