[Pacemaker] Cannot get "order" constraint to work.

Dejan Muhamedagic dejanmm at fastmail.fm
Wed Oct 14 10:36:34 EDT 2009


Hi,

On Wed, Oct 14, 2009 at 05:31:09PM +0300, Stratos Zolotas wrote:
> If i change pacemaker version to "1" from "0" in the openais.conf, openais
> is started without errors, but the crm cannot connect to cluster.
> 
> Which is the difference between "1" and "0" on the "ver" parameter of
> pacemaker in the openais.con?
> 
> Does this mean something? (that openais starts ok).

Don't know, I've always used only ver: 0.

Anyway, if you can't figure out what's going on, please try to
use hb_report and file a bugzilla.

Thanks,

Dejan

> On Wed, Oct 14, 2009 at 5:24 PM, Stratos Zolotas <strzol at gmail.com> wrote:
> 
> > Hi,
> >
> > cores are empty
> >
> > I think i'm on dead end......
> >
> > Thanks.
> >
> >
> > On Wed, Oct 14, 2009 at 5:02 PM, Dejan Muhamedagic <dejanmm at fastmail.fm>wrote:
> >
> >> Hi,
> >>
> >> On Wed, Oct 14, 2009 at 04:39:05PM +0300, Stratos Zolotas wrote:
> >> > Ok, I have installed latest version of pacemaker (1.0.5) from opensuse
> >> > ha-clustering repo, but it is not working.
> >> >
> >> > I'm starting openais on the alpha node and i get a lot of messages. On
> >> the
> >> > bravo node openais fails to start.
> >> >
> >> > The same happens if i start the bravo node first, the on alpha it fails.
> >> >
> >> > Attached is my log. At least it doesn't segfault!
> >> >
> >> > I'm starting to get tired. And with pacamaker 1.0.1 my only problem was
> >> the
> >> > order constraint.
> >> >
> >> > I have also cleared all the configurations (cib.xml and others in
> >> > /var/lib/heartbeat/crm) to start from scratch without success.
> >> >
> >> > Any help is appreciated. I'm feeling lost.
> >>
> >> Hmpf. All pacemaker processes start but leave without trace soon:
> >>
> >> Oct 14 16:22:44 alpha cib: [18888]: info: startCib: CIB Initialization
> >> completed successfully
> >> Oct 14 16:22:44 alpha cib: [18888]: info: crm_cluster_connect: Connecting
> >> to OpenAIS
> >> Oct 14 16:22:44 alpha cib: [18888]: info: init_ais_connection: Creating
> >> connection to our AIS plugin
> >>
> >> That's the last we hear from cib. Unfortunately that's too little
> >> to work on. Maybe they are segfaulting. Can you please check
> >> again /var/lib/heartbeat/cores
> >>
> >> Perhaps somebody else has an idea on what's going on.
> >>
> >> THanks,
> >>
> >> Dejan
> >>
> >> > Thanks in advance.
> >> >
> >> > On Wed, Oct 14, 2009 at 3:21 PM, Stratos Zolotas <strzol at gmail.com>
> >> wrote:
> >> >
> >> > > When i try to install pacemaker-1.0.5-4.1.x86_64 the system (opensuse
> >> 11.1
> >> > > x86_64) asks to downgrade heartbeat-common-2.99.3-1.6.x86_64 to
> >> > > cluster-glue-1.0-12.1.x86_64.
> >> > >
> >> > > Is this ok and normal?
> >> > >
> >> > >
> >> > > On Wed, Oct 14, 2009 at 3:09 PM, Stratos Zolotas <strzol at gmail.com>
> >> wrote:
> >> > >
> >> > >> If you remember with the upgraded version pacemaker 1.0.5, i'm
> >> getting
> >> > >> segfaults on crmd.
> >> > >>
> >> > >> I will try it again. From which repo should i upgrade?
> >> > >>
> >> > >> Thanks.
> >> > >>
> >> > >>
> >> > >> On Wed, Oct 14, 2009 at 3:06 PM, Dejan Muhamedagic <
> >> dejanmm at fastmail.fm>wrote:
> >> > >>
> >> > >>> Hi,
> >> > >>>
> >> > >>> On Wed, Oct 14, 2009 at 01:47:08PM +0300, Stratos Zolotas wrote:
> >> > >>> > Hi,
> >> > >>> >
> >> > >>> > all the packages are from the opensuse standard repos.
> >> > >>> >
> >> > >>> > alpha:/ # /usr/lib64/heartbeat/crmd version
> >> > >>> > CRM Version: 1.0.1 (node:
> >> 27be064e090742359bbdd1914f9d7dd363c8e0d8)
> >> > >>> > alpha:/ #
> >> > >>>
> >> > >>> That's fairly old. Can you please upgrade.
> >> > >>>
> >> > >>> Thanks,
> >> > >>>
> >> > >>> Dejan
> >> > >>>
> >> > >>> > Thanks.
> >> > >>> >
> >> > >>> > On Wed, Oct 14, 2009 at 1:44 PM, Dejan Muhamedagic <
> >> > >>> dejanmm at fastmail.fm>wrote:
> >> > >>> >
> >> > >>> > > Hi,
> >> > >>> > >
> >> > >>> > > On Wed, Oct 14, 2009 at 01:30:32PM +0300, Stratos Zolotas wrote:
> >> > >>> > > > order mysql_after_drbd inf: ms_drbd_mysql:promote mysql:start
> >> > >>> > > >
> >> > >>> > > > is committed ok, but it doesn't show right in the
> >> configuration:
> >> > >>> > > >
> >> > >>> > > > primitive fs_mysql ocf:heartbeat:Filesystem \
> >> > >>> > > >         params device="/dev/drbd0" directory="/service/"
> >> > >>> fstype="ext3"
> >> > >>> > > > primitive ip_mysql ocf:heartbeat:IPaddr2 \
> >> > >>> > > >         params ip="192.168.1.72" nic="eth2:0"
> >> > >>> > > > primitive mysqld lsb:mysql
> >> > >>> > > > primitive apache lsb:apache2
> >> > >>> > > > primitive drbd_mysql ocf:linbit:drbd \
> >> > >>> > > >         params drbd_resource="r0" \
> >> > >>> > > >         operations $id="drbd_mysql-ops" \
> >> > >>> > > >         op monitor interval="15s"
> >> > >>> > > > group mysql fs_mysql ip_mysql mysqld apache
> >> > >>> > > > ms ms_drbd_mysql drbd_mysql \
> >> > >>> > > >         meta master-max="1" master-node-max="1" clone-max="2"
> >> > >>> > > > clone-node-max="1" notify="true"
> >> > >>> > > > colocation mysql_on_drbd INFINITY: mysql ms_drbd_mysql:Master
> >> > >>> > > > order mysql_after_drbd INFINITY:
> >> > >>> > >
> >> > >>> > > Funny. I've never seen this :)
> >> > >>> > >
> >> > >>> > > > property $id="cib-bootstrap-options" \
> >> > >>> > > >         dc-version="1.0.1-node:
> >> > >>> 27be064e090742359bbdd1914f9d7dd363c8e0d8"
> >> > >>> > > \
> >> > >>> > >
> >> > >>> > > Which version do you run? See with /usr/lib/heartbeat/crmd
> >> version.
> >> > >>> > >
> >> > >>> > > Thanks,
> >> > >>> > >
> >> > >>> > > Dejan
> >> > >>> > >
> >> > >>> > > >         no-quorum-policy="ignore" \
> >> > >>> > > >         stonith-enabled="false" \
> >> > >>> > > >         default-resource-stickiness="1000"
> >> > >>> > > >
> >> > >>> > > > And if i exit crm and enter again i get:
> >> > >>> > > >
> >> > >>> > > > alpha:/ # crm
> >> > >>> > > > crm(live)# configure
> >> > >>> > > > ERROR: syntax : order mysql_after_drbd INFINITY:
> >> > >>> > > > crm(live)configure# show
> >> > >>> > > > ERROR: object mysql_after_drbd cannot be represented in the
> >> CLI
> >> > >>> notation
> >> > >>> > > > crm(live)configure#
> >> > >>> > > >
> >> > >>> > > > I'm attaching my log.
> >> > >>> > > >
> >> > >>> > > > Thanks.
> >> > >>> > > >
> >> > >>> > > > On Wed, Oct 14, 2009 at 1:21 PM, Dejan Muhamedagic <
> >> > >>> dejanmm at fastmail.fm
> >> > >>> > > >wrote:
> >> > >>> > > >
> >> > >>> > > > > Hi,
> >> > >>> > > > >
> >> > >>> > > > > On Wed, Oct 14, 2009 at 12:13:42PM +0200, Johan Verrept
> >> wrote:
> >> > >>> > > > > > Sorry, I missed that. Was already wondering why the error
> >> was
> >> > >>> so
> >> > >>> > > > > > cryptic.
> >> > >>> > > > > >
> >> > >>> > > > > > It is definatly possible, I use it myself:
> >> > >>> > > > > >
> >> > >>> > > > > > order drbd-before-master-group inf: ms-drbd0:promote
> >> > >>> > > master-group:start
> >> > >>> > > > > >
> >> > >>> > > > > > And master-group is a group with 3 primitives.
> >> > >>> > > > > >
> >> > >>> > > > > > Maybe try the inf: instead of the mandatory: ?
> >> > >>> > > > >
> >> > >>> > > > > Maybe, that's equal, though mandatory should work fine as
> >> well.
> >> > >>> > > > >
> >> > >>> > > > > The only way to figure out what's going on is to take a look
> >> at
> >> > >>> > > > > the logs.
> >> > >>> > > > >
> >> > >>> > > > > Thanks,
> >> > >>> > > > >
> >> > >>> > > > > Dejan
> >> > >>> > > > >
> >> > >>> > > > > > FYI, I am on pacemaker 1.0.5.
> >> > >>> > > > > >
> >> > >>> > > > > >       J.
> >> > >>> > > > > >
> >> > >>> > > > > > On Wed, 2009-10-14 at 13:11 +0300, Stratos Zolotas wrote:
> >> > >>> > > > > > > As you can see in the config, I have a group named mysql
> >> that
> >> > >>> > > includes
> >> > >>> > > > > > > fs_mysql, ip_mysql, mysqld, apache primitives.
> >> > >>> > > > > > >
> >> > >>> > > > > > > The expecting result is to start this group after
> >> > >>> ms_drbd_mysql is
> >> > >>> > > > > > > promoted to one of the nodes.
> >> > >>> > > > > > >
> >> > >>> > > > > > > Is this wrong? Should I try a different approach?
> >> > >>> > > > > > >
> >> > >>> > > > > > > Stratos.
> >> > >>> > > > > > >
> >> > >>> > > > > > > On Wed, Oct 14, 2009 at 1:02 PM, Johan Verrept <
> >> > >>> > > Johan.Verrept at able.be>
> >> > >>> > > > > > > wrote:
> >> > >>> > > > > > >         I don't know if it is your only problem but in
> >> the
> >> > >>> order
> >> > >>> > > you
> >> > >>> > > > > > >         refer to
> >> > >>> > > > > > >         primitive "mysql" while in your configuration
> >> you
> >> > >>> have
> >> > >>> > > > > > >         primitive
> >> > >>> > > > > > >         "mysqld". Note the "d".
> >> > >>> > > > > > >         Other than that, the order constraint looks like
> >> > >>> mine.
> >> > >>> > > > > > >
> >> > >>> > > > > > >                J.
> >> > >>> > > > > > >
> >> > >>> > > > > > >
> >> > >>> > > > > > >         On Wed, 2009-10-14 at 12:59 +0300, Stratos
> >> Zolotas
> >> > >>> wrote:
> >> > >>> > > > > > >         > Hello again.
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > After struggling with the latest versions, i
> >> > >>> decided to
> >> > >>> > > try
> >> > >>> > > > > > >         with the
> >> > >>> > > > > > >         > versions in the standard opesuse repos, that
> >> means:
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > openais 0.80.3
> >> > >>> > > > > > >         > libopenais2 0.80.3
> >> > >>> > > > > > >         > pacemaker 1.0.1
> >> > >>> > > > > > >         > libpacemaker3 1.0.1
> >> > >>> > > > > > >         > heartbeat 2.99.3
> >> > >>> > > > > > >         > heartbeat-common 2.99.3
> >> > >>> > > > > > >         > heartbeat-resources 2.99.3
> >> > >>> > > > > > >         > libheartbeat2 2.99.3
> >> > >>> > > > > > >         > OpenIPMI 2.0.14
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > It seems to work ok, the nodes are
> >> communicating
> >> > >>> and i
> >> > >>> > > can
> >> > >>> > > > > > >         connect to
> >> > >>> > > > > > >         > cib and create configuration, but i cannot
> >> > >>> configure an
> >> > >>> > > > > > >         order
> >> > >>> > > > > > >         > constraint in the configuration file.
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > I try this:
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > order mysql_after_drbd mandatory:
> >> > >>> ms_drbd_mysql:promote
> >> > >>> > > > > > >         mysql:start
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > But when i try to commit i get:
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > Call cib_create failed (-47): Update does not
> >> > >>> conform to
> >> > >>> > > the
> >> > >>> > > > > > >         > configured schema/DTD
> >> > >>> > > > > > >         > <null>
> >> > >>> > > > > > >         > ERROR: could not create mysql_after_drbd
> >> > >>> > > > > > >         > offending xml: <rsc_order
> >> first="ms_drbd_mysql"
> >> > >>> > > > > > >         first-action="promote"
> >> > >>> > > > > > >         > id="mysql_after_drbd" score="inf" then="mysql"
> >> > >>> > > > > > >         then-action="start"/>
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > Am I doing something wrong?
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > The rest of the configuration is accepted and
> >> is:
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > primitive fs_mysql ocf:heartbeat:Filesystem \
> >> > >>> > > > > > >         >         params device="/dev/drbd0"
> >> > >>> directory="/service/"
> >> > >>> > > > > > >         fstype="ext3"
> >> > >>> > > > > > >         > primitive ip_mysql ocf:heartbeat:IPaddr2 \
> >> > >>> > > > > > >         >         params ip="192.168.1.72" nic="eth2:0"
> >> > >>> > > > > > >         > primitive mysqld lsb:mysql
> >> > >>> > > > > > >         > primitive apache lsb:apache2
> >> > >>> > > > > > >         > primitive drbd_mysql ocf:linbit:drbd \
> >> > >>> > > > > > >         >         params drbd_resource="r0" \
> >> > >>> > > > > > >         >         operations $id="drbd_mysql-ops" \
> >> > >>> > > > > > >         >         op monitor interval="15s"
> >> > >>> > > > > > >         > group mysql fs_mysql ip_mysql mysqld apache
> >> > >>> > > > > > >         > ms ms_drbd_mysql drbd_mysql \
> >> > >>> > > > > > >         >         meta master-max="1"
> >> master-node-max="1"
> >> > >>> > > > > > >         clone-max="2"
> >> > >>> > > > > > >         > clone-node-max="1" notify="true"
> >> > >>> > > > > > >         > colocation mysql_on_drbd INFINITY: mysql
> >> > >>> > > > > > >         ms_drbd_mysql:Master
> >> > >>> > > > > > >         > property $id="cib-bootstrap-options" \
> >> > >>> > > > > > >         >         dc-version="1.0.1-node:
> >> > >>> > > > > > >         > 27be064e090742359bbdd1914f9d7dd363c8e0d8" \
> >> > >>> > > > > > >         >         no-quorum-policy="ignore" \
> >> > >>> > > > > > >         >         stonith-enabled="false" \
> >> > >>> > > > > > >         >         default-resource-stickiness="1000"
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > Thanks in advance
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >         > Stratos.
> >> > >>> > > > > > >         >
> >> > >>> > > > > > >
> >> > >>> > > > > > >         >
> >> _______________________________________________
> >> > >>> > > > > > >         > Pacemaker mailing list
> >> > >>> > > > > > >         > Pacemaker at oss.clusterlabs.org
> >> > >>> > > > > > >         >
> >> > >>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>> > > > > > >
> >> > >>> > > > > > >
> >> > >>> > > > > > >         _______________________________________________
> >> > >>> > > > > > >         Pacemaker mailing list
> >> > >>> > > > > > >         Pacemaker at oss.clusterlabs.org
> >> > >>> > > > > > >
> >> > >>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>> > > > > > >
> >> > >>> > > > > > >
> >> > >>> > > > > > >
> >> > >>> > > > > > > --
> >> > >>> > > > > > > Kernel IT Solutions Ltd
> >> > >>> > > > > > > http://www.kernelit.gr
> >> > >>> > > > > > >
> >> > >>> > > > > > > Cyclades Wireless Network
> >> > >>> > > > > > > http://www.cywn.gr
> >> > >>> > > > > > > _______________________________________________
> >> > >>> > > > > > > Pacemaker mailing list
> >> > >>> > > > > > > Pacemaker at oss.clusterlabs.org
> >> > >>> > > > > > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>> > > > > >
> >> > >>> > > > > >
> >> > >>> > > > > > _______________________________________________
> >> > >>> > > > > > Pacemaker mailing list
> >> > >>> > > > > > Pacemaker at oss.clusterlabs.org
> >> > >>> > > > > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>> > > > >
> >> > >>> > > > > _______________________________________________
> >> > >>> > > > > Pacemaker mailing list
> >> > >>> > > > > Pacemaker at oss.clusterlabs.org
> >> > >>> > > > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>> > > > >
> >> > >>> > > >
> >> > >>> > > >
> >> > >>> > > >
> >> > >>> > > > --
> >> > >>> > > > Kernel IT Solutions Ltd
> >> > >>> > > > http://www.kernelit.gr
> >> > >>> > > >
> >> > >>> > > > Cyclades Wireless Network
> >> > >>> > > > http://www.cywn.gr
> >> > >>> > >
> >> > >>> > >
> >> > >>> > > > _______________________________________________
> >> > >>> > > > Pacemaker mailing list
> >> > >>> > > > Pacemaker at oss.clusterlabs.org
> >> > >>> > > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>> > >
> >> > >>> > >
> >> > >>> > > _______________________________________________
> >> > >>> > > Pacemaker mailing list
> >> > >>> > > Pacemaker at oss.clusterlabs.org
> >> > >>> > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>> > >
> >> > >>>
> >> > >>> > _______________________________________________
> >> > >>> > Pacemaker mailing list
> >> > >>> > Pacemaker at oss.clusterlabs.org
> >> > >>> > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>>
> >> > >>>
> >> > >>> _______________________________________________
> >> > >>> Pacemaker mailing list
> >> > >>> Pacemaker at oss.clusterlabs.org
> >> > >>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >> > >>>
> >> > >>
> >> > >>
> >> > >
> >>
> >>
> >> > _______________________________________________
> >> > Pacemaker mailing list
> >> > Pacemaker at oss.clusterlabs.org
> >> > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >>
> >>
> >> _______________________________________________
> >> Pacemaker mailing list
> >> Pacemaker at oss.clusterlabs.org
> >> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >>
> >
> >

> _______________________________________________
> Pacemaker mailing list
> Pacemaker at oss.clusterlabs.org
> http://oss.clusterlabs.org/mailman/listinfo/pacemaker





More information about the Pacemaker mailing list