<div dir="ltr">Hi!<div><br></div><div style>Fencing is disabled for now, the issue is not with fencing: the question is - why only one out of three DRBD master-slave sets is recognized by pacemaker, even though all three drbd resources are active and configured properly...</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/6/26 Digimer <span dir="ltr"><<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I don't see fencing/stonith configured. Without it, your cluster will<br>
not be stable. You will get DRBD split-brains easily and depending in<br>
what you use DRBD for, you could corrupt your data.<br>
<div><div class="h5"><br>
On 06/25/2013 09:25 AM, Саша Александров wrote:<br>
> Hi all!<br>
><br>
> I am setting up a new cluster on OracleLinux 6.4 (well, it is CentOS 6.4).<br>
> I went through <a href="http://clusterlabs.org/quickstart-redhat.html" target="_blank">http://clusterlabs.org/quickstart-redhat.html</a><br>
> Then I installed DRBD 8.4.2 from elrepo.<br>
> This setup is unusable :-( with DRBD 8.4.2.<br>
> I created three DRBD resources:<br>
><br>
> cat /proc/drbd<br>
> version: 8.4.2 (api:1/proto:86-101)<br>
> GIT-hash: 7ad5f850d711223713d6dcadc3dd48860321070c build by<br>
> root@flashfon1, 2013-06-24 22:08:41<br>
> 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----<br>
> ns:97659171 nr:0 dw:36 dr:97660193 al:1 bm:5961 lo:0 pe:0 ua:0 ap:0<br>
> ep:1 wo:f oos:0<br>
> 1: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----<br>
> ns:292421653 nr:16 dw:16 dr:292422318 al:0 bm:17848 lo:0 pe:0 ua:0<br>
> ap:0 ep:1 wo:f oos:0<br>
> 2: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----<br>
> ns:292421600 nr:8 dw:8 dr:292422265 al:0 bm:17848 lo:0 pe:0 ua:0<br>
> ap:0 ep:1 wo:f oos:0<br>
><br>
> It appeared that drbd resource-agent script did not work. Debugging<br>
> showed that check_crm_feature_set() function always returned zeroes. Ok,<br>
> just added 'exit' as its first line for now.<br>
><br>
> Next, I created three drbd resources in pacemaker, three master-slave<br>
> sets, three filesystem resources (and ip resources, but they are no<br>
> problem):<br>
><br>
> pcs status<br>
> Last updated: Tue Jun 25 21:20:17 2013<br>
> Last change: Tue Jun 25 02:46:25 2013 via crm_resource on flashfon1<br>
> Stack: cman<br>
> Current DC: flashfon1 - partition with quorum<br>
> Version: 1.1.8-7.el6-394e906<br>
> 2 Nodes configured, unknown expected votes<br>
> 11 Resources configured.<br>
><br>
><br>
> Online: [ flashfon1 flashfon2 ]<br>
><br>
> Full list of resources:<br>
><br>
> Master/Slave Set: ms_wsoft [drbd_wsoft]<br>
> Masters: [ flashfon1 ]<br>
> Slaves: [ flashfon2 ]<br>
> Master/Slave Set: ms_oradata [drbd_oradata]<br>
> Slaves: [ flashfon1 flashfon2 ]<br>
> Master/Slave Set: ms_flash [drbd_flash]<br>
> Slaves: [ flashfon1 flashfon2 ]<br>
> Resource Group: WcsGroup<br>
> wcs_vip_local (ocf::heartbeat:IPaddr2): Started flashfon1<br>
> wcs_fs (ocf::heartbeat:Filesystem): Started flashfon1<br>
> Resource Group: OraGroup<br>
> ora_vip_local (ocf::heartbeat:IPaddr2): Started flashfon1<br>
> oradata_fs (ocf::heartbeat:Filesystem): Stopped<br>
> oraflash_fs (ocf::heartbeat:Filesystem): Stopped<br>
><br>
> See, only one master-slave set is recognizing DRBD state!<br>
><br>
> Resources are configured identically in CIB (except for drbd resource<br>
> name parameter):<br>
><br>
> <master id="ms_wsoft"><br>
> <primitive class="ocf" id="drbd_wsoft" provider="linbit"<br>
> type="drbd"><br>
> <instance_attributes id="drbd_wsoft-instance_attributes"><br>
> <nvpair id="drbd_wsoft-instance_attributes-drbd_resource"<br>
> name="drbd_resource" value="wsoft"/><br>
> </instance_attributes><br>
> <operations><br>
> <op id="drbd_wsoft-interval-60s" interval="60s" name="monitor"/><br>
> </operations><br>
> </primitive><br>
> <meta_attributes id="ms_wsoft-meta_attributes"><br>
> <nvpair id="ms_wsoft-meta_attributes-master-max"<br>
> name="master-max" value="1"/><br>
> <nvpair id="ms_wsoft-meta_attributes-master-node-max"<br>
> name="master-node-max" value="1"/><br>
> <nvpair id="ms_wsoft-meta_attributes-clone-max"<br>
> name="clone-max" value="2"/><br>
> <nvpair id="ms_wsoft-meta_attributes-clone-node-max"<br>
> name="clone-node-max" value="1"/><br>
> <nvpair id="ms_wsoft-meta_attributes-notify" name="notify"<br>
> value="true"/><br>
> </meta_attributes><br>
> </master><br>
> <master id="ms_oradata"><br>
> <primitive class="ocf" id="drbd_oradata" provider="linbit"<br>
> type="drbd"><br>
> <instance_attributes id="drbd_oradata-instance_attributes"><br>
> <nvpair id="drbd_oradata-instance_attributes-drbd_resource"<br>
> name="drbd_resource" value="oradata"/><br>
> </instance_attributes><br>
> <operations><br>
> <op id="drbd_oradata-interval-60s" interval="60s"<br>
> name="monitor"/><br>
> </operations><br>
> </primitive><br>
> <meta_attributes id="ms_oradata-meta_attributes"><br>
> <nvpair id="ms_oradata-meta_attributes-master-max"<br>
> name="master-max" value="1"/><br>
> <nvpair id="ms_oradata-meta_attributes-master-node-max"<br>
> name="master-node-max" value="1"/><br>
> <nvpair id="ms_oradata-meta_attributes-clone-max"<br>
> name="clone-max" value="2"/><br>
> <nvpair id="ms_oradata-meta_attributes-clone-node-max"<br>
> name="clone-node-max" value="1"/><br>
> <nvpair id="ms_oradata-meta_attributes-notify" name="notify"<br>
> value="true"/><br>
> </meta_attributes><br>
> </master><br>
><br>
> I am stuck. :-((((<br>
><br>
> Best regards,<br>
> Alexandr A. Alexandrov<br>
><br>
><br>
</div></div>> _______________________________________________<br>
> Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
> <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
><br>
> Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
> Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
> Bugs: <a href="http://bugs.clusterlabs.org" target="_blank">http://bugs.clusterlabs.org</a><br>
><br>
<span class="HOEnZb"><font color="#888888"><br>
<br>
--<br>
Digimer<br>
Papers and Projects: <a href="https://alteeve.ca/w/" target="_blank">https://alteeve.ca/w/</a><br>
What if the cure for cancer is trapped in the mind of a person without<br>
access to education?<br>
</font></span></blockquote></div><br><br clear="all"><div><br></div>-- <br>С уважением, ААА.
</div>