<div dir="ltr">Hi!<div><br></div><div style>Fencing is disabled for now, the issue is not with fencing: the question is - why only one out of three DRBD master-slave sets is recognized by pacemaker, even though all three drbd resources are active and configured properly...</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/6/26 Digimer <span dir="ltr">&lt;<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a>&gt;</span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I don&#39;t see fencing/stonith configured. Without it, your cluster will<br>
not be stable. You will get DRBD split-brains easily and depending in<br>
what you use DRBD for, you could corrupt your data.<br>
<div><div class="h5"><br>
On 06/25/2013 09:25 AM, Саша Александров wrote:<br>
&gt; Hi all!<br>
&gt;<br>
&gt; I am setting up a new cluster on OracleLinux 6.4 (well, it is CentOS 6.4).<br>
&gt; I went through <a href="http://clusterlabs.org/quickstart-redhat.html" target="_blank">http://clusterlabs.org/quickstart-redhat.html</a><br>
&gt; Then I installed DRBD 8.4.2 from elrepo.<br>
&gt; This setup is unusable :-( with DRBD 8.4.2.<br>
&gt; I created three DRBD resources:<br>
&gt;<br>
&gt; cat /proc/drbd<br>
&gt; version: 8.4.2 (api:1/proto:86-101)<br>
&gt; GIT-hash: 7ad5f850d711223713d6dcadc3dd48860321070c build by<br>
&gt; root@flashfon1, 2013-06-24 22:08:41<br>
&gt;  0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----<br>
&gt;     ns:97659171 nr:0 dw:36 dr:97660193 al:1 bm:5961 lo:0 pe:0 ua:0 ap:0<br>
&gt; ep:1 wo:f oos:0<br>
&gt;  1: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----<br>
&gt;     ns:292421653 nr:16 dw:16 dr:292422318 al:0 bm:17848 lo:0 pe:0 ua:0<br>
&gt; ap:0 ep:1 wo:f oos:0<br>
&gt;  2: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----<br>
&gt;     ns:292421600 nr:8 dw:8 dr:292422265 al:0 bm:17848 lo:0 pe:0 ua:0<br>
&gt; ap:0 ep:1 wo:f oos:0<br>
&gt;<br>
&gt; It appeared that drbd resource-agent script did not work. Debugging<br>
&gt; showed that check_crm_feature_set() function always returned zeroes. Ok,<br>
&gt; just added &#39;exit&#39; as its first line for now.<br>
&gt;<br>
&gt; Next, I created three drbd resources in pacemaker, three master-slave<br>
&gt; sets, three filesystem resources (and ip resources, but they are no<br>
&gt; problem):<br>
&gt;<br>
&gt;  pcs status<br>
&gt; Last updated: Tue Jun 25 21:20:17 2013<br>
&gt; Last change: Tue Jun 25 02:46:25 2013 via crm_resource on flashfon1<br>
&gt; Stack: cman<br>
&gt; Current DC: flashfon1 - partition with quorum<br>
&gt; Version: 1.1.8-7.el6-394e906<br>
&gt; 2 Nodes configured, unknown expected votes<br>
&gt; 11 Resources configured.<br>
&gt;<br>
&gt;<br>
&gt; Online: [ flashfon1 flashfon2 ]<br>
&gt;<br>
&gt; Full list of resources:<br>
&gt;<br>
&gt;  Master/Slave Set: ms_wsoft [drbd_wsoft]<br>
&gt;      Masters: [ flashfon1 ]<br>
&gt;      Slaves: [ flashfon2 ]<br>
&gt;  Master/Slave Set: ms_oradata [drbd_oradata]<br>
&gt;      Slaves: [ flashfon1 flashfon2 ]<br>
&gt;  Master/Slave Set: ms_flash [drbd_flash]<br>
&gt;      Slaves: [ flashfon1 flashfon2 ]<br>
&gt;  Resource Group: WcsGroup<br>
&gt;      wcs_vip_local      (ocf::heartbeat:IPaddr2):       Started flashfon1<br>
&gt;      wcs_fs     (ocf::heartbeat:Filesystem):    Started flashfon1<br>
&gt;  Resource Group: OraGroup<br>
&gt;      ora_vip_local      (ocf::heartbeat:IPaddr2):       Started flashfon1<br>
&gt;      oradata_fs (ocf::heartbeat:Filesystem):    Stopped<br>
&gt;      oraflash_fs        (ocf::heartbeat:Filesystem):    Stopped<br>
&gt;<br>
&gt; See, only one master-slave set is recognizing DRBD state!<br>
&gt;<br>
&gt; Resources are configured identically in CIB (except for drbd resource<br>
&gt; name parameter):<br>
&gt;<br>
&gt;       &lt;master id=&quot;ms_wsoft&quot;&gt;<br>
&gt;         &lt;primitive class=&quot;ocf&quot; id=&quot;drbd_wsoft&quot; provider=&quot;linbit&quot;<br>
&gt; type=&quot;drbd&quot;&gt;<br>
&gt;           &lt;instance_attributes id=&quot;drbd_wsoft-instance_attributes&quot;&gt;<br>
&gt;             &lt;nvpair id=&quot;drbd_wsoft-instance_attributes-drbd_resource&quot;<br>
&gt; name=&quot;drbd_resource&quot; value=&quot;wsoft&quot;/&gt;<br>
&gt;           &lt;/instance_attributes&gt;<br>
&gt;           &lt;operations&gt;<br>
&gt;             &lt;op id=&quot;drbd_wsoft-interval-60s&quot; interval=&quot;60s&quot; name=&quot;monitor&quot;/&gt;<br>
&gt;           &lt;/operations&gt;<br>
&gt;         &lt;/primitive&gt;<br>
&gt;         &lt;meta_attributes id=&quot;ms_wsoft-meta_attributes&quot;&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_wsoft-meta_attributes-master-max&quot;<br>
&gt; name=&quot;master-max&quot; value=&quot;1&quot;/&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_wsoft-meta_attributes-master-node-max&quot;<br>
&gt; name=&quot;master-node-max&quot; value=&quot;1&quot;/&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_wsoft-meta_attributes-clone-max&quot;<br>
&gt; name=&quot;clone-max&quot; value=&quot;2&quot;/&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_wsoft-meta_attributes-clone-node-max&quot;<br>
&gt; name=&quot;clone-node-max&quot; value=&quot;1&quot;/&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_wsoft-meta_attributes-notify&quot; name=&quot;notify&quot;<br>
&gt; value=&quot;true&quot;/&gt;<br>
&gt;         &lt;/meta_attributes&gt;<br>
&gt;       &lt;/master&gt;<br>
&gt;       &lt;master id=&quot;ms_oradata&quot;&gt;<br>
&gt;         &lt;primitive class=&quot;ocf&quot; id=&quot;drbd_oradata&quot; provider=&quot;linbit&quot;<br>
&gt; type=&quot;drbd&quot;&gt;<br>
&gt;           &lt;instance_attributes id=&quot;drbd_oradata-instance_attributes&quot;&gt;<br>
&gt;             &lt;nvpair id=&quot;drbd_oradata-instance_attributes-drbd_resource&quot;<br>
&gt; name=&quot;drbd_resource&quot; value=&quot;oradata&quot;/&gt;<br>
&gt;           &lt;/instance_attributes&gt;<br>
&gt;           &lt;operations&gt;<br>
&gt;             &lt;op id=&quot;drbd_oradata-interval-60s&quot; interval=&quot;60s&quot;<br>
&gt; name=&quot;monitor&quot;/&gt;<br>
&gt;           &lt;/operations&gt;<br>
&gt;         &lt;/primitive&gt;<br>
&gt;         &lt;meta_attributes id=&quot;ms_oradata-meta_attributes&quot;&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_oradata-meta_attributes-master-max&quot;<br>
&gt; name=&quot;master-max&quot; value=&quot;1&quot;/&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_oradata-meta_attributes-master-node-max&quot;<br>
&gt; name=&quot;master-node-max&quot; value=&quot;1&quot;/&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_oradata-meta_attributes-clone-max&quot;<br>
&gt; name=&quot;clone-max&quot; value=&quot;2&quot;/&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_oradata-meta_attributes-clone-node-max&quot;<br>
&gt; name=&quot;clone-node-max&quot; value=&quot;1&quot;/&gt;<br>
&gt;           &lt;nvpair id=&quot;ms_oradata-meta_attributes-notify&quot; name=&quot;notify&quot;<br>
&gt; value=&quot;true&quot;/&gt;<br>
&gt;         &lt;/meta_attributes&gt;<br>
&gt;       &lt;/master&gt;<br>
&gt;<br>
&gt; I am stuck. :-((((<br>
&gt;<br>
&gt; Best regards,<br>
&gt; Alexandr A. Alexandrov<br>
&gt;<br>
&gt;<br>
</div></div>&gt; _______________________________________________<br>
&gt; Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
&gt; <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
&gt;<br>
&gt; Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
&gt; Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
&gt; Bugs: <a href="http://bugs.clusterlabs.org" target="_blank">http://bugs.clusterlabs.org</a><br>
&gt;<br>
<span class="HOEnZb"><font color="#888888"><br>
<br>
--<br>
Digimer<br>
Papers and Projects: <a href="https://alteeve.ca/w/" target="_blank">https://alteeve.ca/w/</a><br>
What if the cure for cancer is trapped in the mind of a person without<br>
access to education?<br>
</font></span></blockquote></div><br><br clear="all"><div><br></div>-- <br>С уважением, ААА.
</div>