<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoNoSpacing, li.MsoNoSpacing, div.MsoNoSpacing
{mso-style-priority:1;
margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
p.Code, li.Code, div.Code
{mso-style-name:Code;
margin:0cm;
margin-bottom:.0001pt;
font-size:9.0pt;
font-family:"Courier New";
mso-fareast-language:EN-US;}
span.EmailStyle19
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:309208941;
mso-list-type:hybrid;
mso-list-template-ids:-2045103248 134807567 134807577 134807579 134807567 134807577 134807579 134807567 134807577 134807579;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-GB link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>Hello everyone.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I built and put into production without adequate testing a 2 node cluster running Ubuntu 10.04 LTS with Pacemaker and associated packages from the Ubuntu-HA-maintainers repo (https://launchpad.net/~ubuntu-ha-maintainers/+archive/ppa). <o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I’ve always had many problems with my build, mainly because it was over-complicated and I didn’t have adequate time to test it and tweak it before putting it live. If I list my problems below, could anyone have a look and see if there is anything obvious? Thanks.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>DRBD doesn’t promote/demote correctly. Whenever I have a failover, the DRBD resource will just sit there on the wrong node, holding up all other operations. It’s like the demote never happens. Nothing is logged when this happens, it just sits forever with half of the resources stopped and DRBD master on the wrong node. I’m using the Linbit RA with the following config:<o:p></o:p></p><p class=MsoListParagraph><o:p> </o:p></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>primitive DRBD_MySQL ocf:linbit:drbd \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> params drbd_resource="DRBD_MySQL" \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> meta failure-timeout="60" migration-threshold="10" \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> op monitor interval="30s"<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>primitive fs_DRBD_MySQL ocf:heartbeat:Filesystem \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> params device="/dev/drbd/by-res/DRBD_MySQL" directory="/var/lib/mysql" fstype="ext4" \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> meta failure-timeout="60" migration-threshold="10" target-role="Started" \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> op monitor interval="30s"<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>primitive MySQL lsb:mysql \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> meta failure-timeout="60" migration-threshold="10" target-role="Started" \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> op monitor interval="30s"<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>ms ms_DRBD_MySQL DRBD_MySQL \<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" target-role="Master"<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>colocation MySQL_on_ms_DRBD_MySQL inf: MySQL ms_DRBD_MySQL:Master<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>colocation fs_on_DRBD_MySQL inf: fs_DRBD_MySQL ms_DRBD_MySQL:Master<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>order MySQL_after_DRBD inf: fs_DRBD_MySQL:start MySQL:start<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>order fs_after_DRBD_MySQL inf: ms_DRBD_MySQL:promote fs_DRBD_MySQL:start<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><o:p> </o:p></p><p class=MsoNormal style='margin-left:36.0pt'>/etc/drbd.conf:<o:p></o:p></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>global {<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> usage-count yes;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>}<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>common {<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> protocol C;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>}<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>resource DRBD_MySQL {<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> syncer {<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> rate 100M;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> }<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> net {<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> after-sb-0pri discard-zero-changes;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> after-sb-1pri discard-secondary;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> }<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> on OGW-HOSTING-01 {<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> device /dev/drbd2;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> disk /dev/vg1/MySQL;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> address 10.0.0.1:7790;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> flexible-meta-disk internal;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> }<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> on OGW-HOSTING-02 {<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> device /dev/drbd2;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> disk /dev/vg1/MySQL;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> address 10.0.0.2:7790;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> flexible-meta-disk internal;<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'> }<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='font-size:8.0pt;font-family:"Courier New"'>}<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><o:p> </o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Crm shell won’t load from a text file. When I use crm configure < crm.txt, it will run through the file, complaining about the default timeout being less than 240, but doesn’t load anything. So I go into the crm shell and set default-action-timeout to 240, commit and exit and do the same. This time it just exits silently, without loading the config. If I go into the crm shell and use load replace crm.txt it will work.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>3.<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Crm shell tab completes don’t work unless you put an incorrect entry in first. I’m sure this is a python readline problem, as it also happens in SLE 11 HAE SP1 (but not in pre-SP1). I assume everyone associated (Dejan?) is aware of the problem, but highlighting it just in case.<o:p></o:p></p><p class=MsoListParagraph><o:p> </o:p></p><p class=MsoNormal>I’ve attached my crm config, cib XML, /etc/drbd.conf for reference. Please forgive my SSH STONITH, I’ve not had chance to get the IBM RSA configured on it yet.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Thanks all!<o:p></o:p></p><p class=MsoNormal>Best regards,<o:p></o:p></p><p class=MsoNormal>Darren Mansell<o:p></o:p></p></div></body></html>