[Pacemaker] mysql resource agent
Keith Ouellette
KeithO at fibermountain.com
Wed Oct 29 14:57:03 EDT 2014
I am running two servers (Ubuntu 14.04 LTS) as an HA setup for an application that uses mysql. I am using DRBD to replicate the data between the servers and am able to manually start mysql on each server. The DRBD replication is also working fine and Pacemaker (version 1.1.10) seems to handle that properly. I then created a resource for mysql to start it on the active node.
All this I am doing with LCMC (although, I hope that should not matter). When I start the mysql resource, it shows that it is started:
fmadmin at AOS1:/$ sudo crm status
Last updated: Wed Oct 29 14:43:31 2014
Last change: Wed Oct 29 13:56:10 2014 via crm_resource on AOS1
Stack: corosync
Current DC: AOS1 (172655985) - partition with quorum
Version: 1.1.10-42f2063
2 Nodes configured
5 Resources configured
Online: [ AOS1 AOS2 ]
Master/Slave Set: ms_drbd_1 [res_drbd_1]
Masters: [ AOS1 ]
Slaves: [ AOS2 ]
res_Filesystem_1 (ocf::heartbeat:Filesystem): Started AOS1
res_IPaddr2_1 (ocf::heartbeat:IPaddr2): Started AOS1
res_mysql_1 (service:mysql): Started AOS1
However, the service did not start:
fmadmin at AOS1:/$ sudo service mysql status
mysql stop/waiting
I see the following error in syslog:
Oct 29 13:56:12 AOS1 crmd[40578]: error: crm_xml_err: XML Error: Entity: line 1: parser error : Start tag expected, '<' not found
Oct 29 13:56:12 AOS1 crmd[40578]: error: crm_xml_err: XML Error: Usage: /etc/init.d/mysql start|stop|restart|reload|force-reload|status
Oct 29 13:56:12 AOS1 crmd[40578]: error: crm_xml_err: XML Error: ^
Oct 29 13:56:12 AOS1 crmd[40578]: warning: string2xml: Parsing failed (domain=1, level=3, code=4): Start tag expected, '<' not found
Oct 29 13:56:12 AOS1 crmd[40578]: error: crm_abort: string2xml: Forked child 21538 to record non-fatal assert at xml.c:589 : Cannot parse an empty string
Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21533]: /usr/bin/mysql_upgrade: the '--basedir' option is always ignored
Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21533]: Looking for 'mysql' as: /usr/bin/mysql
Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21533]: Looking for 'mysqlcheck' as: /usr/bin/mysqlcheck
Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21533]: This installation of MySQL is already upgraded to 5.5.40, use --force if you still need to run mysql_upgrade
Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21550]: Checking for insecure root accounts.
Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21555]: Triggering myisam-recover for all MyISAM tables
Oct 29 13:56:12 AOS1 crmd[40578]: error: get_rsc_restart_list: Metadata for (null)::service:mysql is not valid XML
Oct 29 13:56:12 AOS1 crmd[40578]: notice: process_lrm_event: LRM operation res_mysql_1_start_0 (call=334, rc=0, cib-update=84, confirmed=true) ok
Oct 29 13:56:12 AOS1 crmd[40578]: notice: te_rsc_command: Initiating action 43: monitor res_mysql_1_monitor_15000 on AOS1 (local)
It looks like the resource agent is giving a bad command? Or at least that is what it appears to be. Any ideas?
Here is a dump of the configuration:
fmadmin at AOS1:/$ sudo cibadmin --query
<cib epoch="210" num_updates="3" admin_epoch="0" validate-with="pacemaker-1.2" crm_feature_set="3.0.7" cib-last-written="Wed Oct 29 13:56:10 2014" update-origin="AOS1" update-client="crm_resource" have-quorum="1" dc-uuid="172655985">
<configuration>
<crm_config>
<cluster_property_set id="cib-bootstrap-options">
<nvpair id="cib-bootstrap-options-stonith-enabled" name="stonith-enabled" value="false"/>
<nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.1.10-42f2063"/>
<nvpair id="cib-bootstrap-options-no-quorum-policy" name="no-quorum-policy" value="ignore"/>
<nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="corosync"/>
<nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1414603959"/>
</cluster_property_set>
</crm_config>
<nodes>
<node id="172655986" uname="AOS2"/>
<node id="172655985" uname="AOS1"/>
</nodes>
<resources>
<master id="ms_drbd_1">
<meta_attributes id="ms_drbd_1-meta_attributes">
<nvpair id="ms_drbd_1-meta_attributes-clone-max" name="clone-max" value="2"/>
<nvpair id="ms_drbd_1-meta_attributes-notify" name="notify" value="true"/>
<nvpair id="ms_drbd_1-meta_attributes-interleave" name="interleave" value="true"/>
</meta_attributes>
<primitive id="res_drbd_1" class="ocf" provider="linbit" type="drbd">
<instance_attributes id="res_drbd_1-instance_attributes">
<nvpair id="nvpair-res_drbd_1-drbd_resource" name="drbd_resource" value="r0"/>
</instance_attributes>
<operations id="res_drbd_1-operations">
<op interval="0" id="op-res_drbd_1-start" name="start" timeout="240"/>
<op interval="0" id="op-res_drbd_1-promote" name="promote" timeout="90"/>
<op interval="0" id="op-res_drbd_1-demote" name="demote" timeout="90"/>
<op interval="0" id="op-res_drbd_1-stop" name="stop" timeout="100"/>
<op id="op-res_drbd_1-monitor" name="monitor" interval="10" timeout="20" start-delay="0"/>
<op interval="0" id="op-res_drbd_1-notify" name="notify" timeout="90"/>
</operations>
<meta_attributes id="res_drbd_1-meta_attributes"/>
</primitive>
</master>
<primitive id="res_Filesystem_1" class="ocf" provider="heartbeat" type="Filesystem">
<instance_attributes id="res_Filesystem_1-instance_attributes">
<nvpair id="nvpair-res_Filesystem_1-device" name="device" value="/dev/drbd/by-res/r0/0"/>
<nvpair id="nvpair-res_Filesystem_1-directory" name="directory" value="/var/lib/mysql/data"/>
<nvpair id="nvpair-res_Filesystem_1-fstype" name="fstype" value="ext4"/>
</instance_attributes>
<operations id="res_Filesystem_1-operations">
<op interval="0" id="op-res_Filesystem_1-start" name="start" timeout="60"/>
<op interval="0" id="op-res_Filesystem_1-stop" name="stop" timeout="60"/>
<op id="op-res_Filesystem_1-monitor" name="monitor" interval="20" timeout="40" start-delay="0"/>
<op interval="0" id="op-res_Filesystem_1-notify" name="notify" timeout="60"/>
</operations>
<meta_attributes id="res_Filesystem_1-meta_attributes"/>
</primitive>
<primitive id="res_IPaddr2_1" class="ocf" provider="heartbeat" type="IPaddr2">
<instance_attributes id="res_IPaddr2_1-instance_attributes">
<nvpair id="nvpair-res_IPaddr2_1-ip" name="ip" value="10.74.133.120"/>
<nvpair id="nvpair-res_IPaddr2_1-cidr_netmask" name="cidr_netmask" value="24"/>
</instance_attributes>
<operations id="res_IPaddr2_1-operations">
<op interval="0" id="op-res_IPaddr2_1-start" name="start" timeout="20"/>
<op interval="0" id="op-res_IPaddr2_1-stop" name="stop" timeout="20"/>
<op id="op-res_IPaddr2_1-monitor" name="monitor" interval="10" timeout="20" start-delay="0"/>
</operations>
<meta_attributes id="res_IPaddr2_1-meta_attributes"/>
</primitive>
<primitive id="res_mysql_1" class="service" type="mysql">
<operations id="res_mysql_1-operations">
<op interval="0" id="op-res_mysql_1-start" name="start" timeout="15"/>
<op interval="0" id="op-res_mysql_1-stop" name="stop" timeout="15"/>
<op id="op-res_mysql_1-monitor" name="monitor" interval="15" timeout="15" start-delay="15"/>
</operations>
<meta_attributes id="res_mysql_1-meta_attributes">
<nvpair id="res_mysql_1-meta_attributes-target-role" name="target-role" value="started"/>
</meta_attributes>
</primitive>
</resources>
<constraints>
<rsc_colocation id="col_res_Filesystem_1_ms_drbd_1" score="INFINITY" with-rsc-role="Master" rsc="res_Filesystem_1" with-rsc="ms_drbd_1"/>
<rsc_order id="ord_ms_drbd_1_res_Filesystem_1" score="INFINITY" first-action="promote" then-action="start" first="ms_drbd_1" then="res_Filesystem_1"/>
<rsc_colocation id="col_res_IPaddr2_1_res_Filesystem_1" score="INFINITY" rsc="res_IPaddr2_1" with-rsc="res_Filesystem_1"/>
<rsc_order id="ord_res_Filesystem_1_res_IPaddr2_1" score="INFINITY" first="res_Filesystem_1" then="res_IPaddr2_1"/>
<rsc_colocation id="col_res_mysql_1_res_IPaddr2_1" score="INFINITY" rsc="res_mysql_1" with-rsc="res_IPaddr2_1"/>
<rsc_order id="ord_res_IPaddr2_1_res_mysql_1" score="INFINITY" first="res_IPaddr2_1" then="res_mysql_1"/>
</constraints>
<rsc_defaults>
<meta_attributes id="rsc-options"/>
</rsc_defaults>
</configuration>
<status>
<node_state id="172655985" uname="AOS1" in_ccm="true" crmd="online" crm-debug-origin="do_update_resource" join="member" expected="member">
<lrm id="172655985">
<lrm_resources>
<lrm_resource id="res_IPaddr2_1" type="IPaddr2" class="ocf" provider="heartbeat">
<lrm_rsc_op id="res_IPaddr2_1_last_failure_0" operation_key="res_IPaddr2_1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="6:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;6:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="239" rc-code="0" op-status="0" interval="0" last-run="1414602513" last-rc-change="1414602513" exec-time="329" queue-time="1" op-digest="7f04d9658437ab9175a91b9f55323554"/>
<lrm_rsc_op id="res_IPaddr2_1_monitor_10000" operation_key="res_IPaddr2_1_monitor_10000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="41:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;41:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="249" rc-code="0" op-status="0" interval="10000" last-rc-change="1414602514" exec-time="137" queue-time="0" op-digest="d7b2c923b15841dad31e4a017ffc8994"/>
</lrm_resource>
<lrm_resource id="res_Filesystem_1" type="Filesystem" class="ocf" provider="heartbeat">
<lrm_rsc_op id="res_Filesystem_1_last_failure_0" operation_key="res_Filesystem_1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="5:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;5:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="237" rc-code="0" op-status="0" interval="0" last-run="1414602513" last-rc-change="1414602513" exec-time="430" queue-time="0" op-digest="4abfd90c648656839a548d5fd571549e"/>
<lrm_rsc_op id="res_Filesystem_1_monitor_20000" operation_key="res_Filesystem_1_monitor_20000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="38:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;38:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="247" rc-code="0" op-status="0" interval="20000" last-rc-change="1414602514" exec-time="159" queue-time="0" op-digest="f4c52ea5791702decf57d3bc7d72019a"/>
</lrm_resource>
<lrm_resource id="res_drbd_1" type="drbd" class="ocf" provider="linbit">
<lrm_rsc_op id="res_drbd_1_last_failure_0" operation_key="res_drbd_1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="4:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:8;4:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="235" rc-code="8" op-status="0" interval="0" last-run="1414602513" last-rc-change="1414602513" exec-time="553" queue-time="0" op-digest="c0e018b73fdf522b6cdd355e125af15e"/>
</lrm_resource>
<lrm_resource id="res_mysql_1" type="mysql" class="service">
<lrm_rsc_op id="res_mysql_1_last_0" operation_key="res_mysql_1_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="42:77:0:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;42:77:0:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="334" rc-code="0" op-status="0" interval="0" last-run="1414605370" last-rc-change="1414605370" exec-time="2193" queue-time="0" op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/>
<lrm_rsc_op id="res_mysql_1_monitor_15000" operation_key="res_mysql_1_monitor_15000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="43:77:0:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;43:77:0:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="337" rc-code="0" op-status="0" interval="15000" last-rc-change="1414605387" exec-time="29" queue-time="15001" op-digest="02a5bcf940fc8d3239701acb11438d6a"/>
</lrm_resource>
</lrm_resources>
</lrm>
<transient_attributes id="172655985">
<instance_attributes id="status-172655985">
<nvpair id="status-172655985-master-res_drbd_1" name="master-res_drbd_1" value="10000"/>
<nvpair id="status-172655985-probe_complete" name="probe_complete" value="true"/>
<nvpair id="status-172655985-last-failure-res_mysql_1" name="last-failure-res_mysql_1" value="1414603330"/>
</instance_attributes>
</transient_attributes>
</node_state>
<node_state id="172655986" uname="AOS2" in_ccm="true" crmd="online" crm-debug-origin="do_update_resource" join="member" expected="member">
<lrm id="172655986">
<lrm_resources>
<lrm_resource id="res_IPaddr2_1" type="IPaddr2" class="ocf" provider="heartbeat">
<lrm_rsc_op id="res_IPaddr2_1_last_0" operation_key="res_IPaddr2_1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="11:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:7;11:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="184" rc-code="7" op-status="0" interval="0" last-run="1414602513" last-rc-change="1414602513" exec-time="119" queue-time="1" op-digest="7f04d9658437ab9175a91b9f55323554"/>
</lrm_resource>
<lrm_resource id="res_Filesystem_1" type="Filesystem" class="ocf" provider="heartbeat">
<lrm_rsc_op id="res_Filesystem_1_last_0" operation_key="res_Filesystem_1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="10:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:7;10:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="182" rc-code="7" op-status="0" interval="0" last-run="1414602513" last-rc-change="1414602513" exec-time="161" queue-time="0" op-digest="4abfd90c648656839a548d5fd571549e"/>
</lrm_resource>
<lrm_resource id="res_drbd_1" type="drbd" class="ocf" provider="linbit">
<lrm_rsc_op id="res_drbd_1_last_failure_0" operation_key="res_drbd_1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="9:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;9:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="180" rc-code="0" op-status="0" interval="0" last-run="1414602513" last-rc-change="1414602513" exec-time="221" queue-time="0" op-digest="c0e018b73fdf522b6cdd355e125af15e"/>
<lrm_rsc_op id="res_drbd_1_monitor_10000" operation_key="res_drbd_1_monitor_10000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="11:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;11:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="192" rc-code="0" op-status="0" interval="10000" last-rc-change="1414602514" exec-time="72" queue-time="0" op-digest="db2fb3216fa7207fdc0b2bf31bbd09c1"/>
</lrm_resource>
<lrm_resource id="res_mysql_1" type="mysql" class="service">
<lrm_rsc_op id="res_mysql_1_last_0" operation_key="res_mysql_1_stop_0" operation="stop" crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" transition-key="42:72:0:92c79007-7c90-4700-8214-0f89457a3dd7" transition-magic="0:0;42:72:0:92c79007-7c90-4700-8214-0f89457a3dd7" call-id="212" rc-code="0" op-status="0" interval="0" last-run="1414604049" last-rc-change="1414604049" exec-time="2078" queue-time="0" op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/>
</lrm_resource>
</lrm_resources>
</lrm>
<transient_attributes id="172655986">
<instance_attributes id="status-172655986">
<nvpair id="status-172655986-master-res_drbd_1" name="master-res_drbd_1" value="10000"/>
<nvpair id="status-172655986-probe_complete" name="probe_complete" value="true"/>
</instance_attributes>
</transient_attributes>
</node_state>
</status>
</cib>
[cid:fm-logo69d803]<http://www.fibermountain.com>
Keith Ouellette
KeithO at fibermountain.com
700 West Johnson Avenue
Cheshire, CT06410
www.fibermountain.com [cid:redlineef0ed4] P. (203) 806-4046
C. (860) 810-4877
F. (845) 358-7882
Disclaimer: The information contained in this communication is confidential, may be privileged and is intended for the exclusive use of the above named addressee(s). If you are not the intended recipient(s), you are expressly prohibited from copying, distributing, disseminating, or in any other way using any information contained within this communication. If you have received this communication in error, please contact the sender by telephone or by response via mail. We have taken precautions to minimize the risk of transmitting software viruses, but we advise you to carry out your own virus checks on this message, as well as any attachments. We cannot accept liability for any loss or damage caused by software viruses.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.clusterlabs.org/pipermail/pacemaker/attachments/20141029/678876e3/attachment-0002.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: fm-logo69d803
Type: image/jpeg
Size: 18744 bytes
Desc: fm-logo69d803
URL: <http://lists.clusterlabs.org/pipermail/pacemaker/attachments/20141029/678876e3/attachment-0004.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: redlineef0ed4
Type: image/jpeg
Size: 538 bytes
Desc: redlineef0ed4
URL: <http://lists.clusterlabs.org/pipermail/pacemaker/attachments/20141029/678876e3/attachment-0005.jpe>
More information about the Pacemaker
mailing list