Hi<br><br> I was able to complete CTS.<br> A bad point is the following points.<br> 1)Python after 2.5 is necessary.<br> However, I used 2.4 of RHEL5.5.<br> Therefore I carried out CTS with Python 2.6.5 of RHEL6.0.<br>
2)The following environment variables are necessary.<br> * cluster_log=/share/ha/logs/ha-log-local7<br> * cluster_hosts="cts0101 cts0102"<br> 3)It started to add stonith-enabled to cib-bootstrap-options to let you read cib.xml.<br>
The following errors occur unless they do so it.<br>-----<br>Jan 27 12:02:39 BadNews: Jan 27 12:01:17 cts0201 pengine: [14630]: ERROR: unpack_resources: Resource start-up disabled since no STONITH resources have been defined<br>
Jan 27 12:02:39 BadNews: Jan 27 12:01:17 cts0201 pengine: [14630]: ERROR: unpack_resources: Either configure some or disable STONITH with the stonith-enabled option<br>Jan 27 12:02:39 BadNews: Jan 27 12:01:17 cts0201 pengine: [14630]: ERROR: unpack_resources: NOTE: Clusters with shared data need STONITH to ensure data integrity<br>
----<br><br>The log is as follows when I carried out CTS.<br>---<br>[buildbot@bbs02 /usr/share/pacemaker/tests/cts]$ python CTSlab.py --nodes "cts0201 cts0202" --at-boot 1 --stack corosync --stonith no --logfile /share/ha/logs/ha-log-local7 --syslog-facility local7 --cib-filename /share/ha/cib.xml 10<br>
Jan 27 15:48:41 Random seed is: 1296110921<br>Jan 27 15:48:41 >>>>>>>>>>>>>>>> BEGINNING 10 TESTS<br>Jan 27 15:48:41 Stack: corosync (flatiron)<br>Jan 27 15:48:41 Schema: pacemaker-1.0<br>
Jan 27 15:48:41 Scenario: Random Test Execution<br>Jan 27 15:48:41 Random Seed: 1296110921<br>Jan 27 15:48:41 System log files: /share/ha/logs/ha-log-local7<br>Jan 27 15:48:41 Cluster nodes:<br>Jan 27 15:48:41 * cts0201<br>
Jan 27 15:48:41 * cts0202<br>Jan 27 15:48:53 Testing for syslog logs<br>Jan 27 15:48:53 Testing for remote logs<br>Jan 27 15:49:31 Continuing with remote-based log reader<br>Jan 27 15:49:42 Stopping Cluster Manager on all nodes<br>
Jan 27 15:49:42 Starting Cluster Manager on all nodes.<br>Jan 27 15:49:42 Starting crm-flatiron on node cts0201<br>Jan 27 15:51:07 Starting crm-flatiron on node cts0202<br>Jan 27 15:52:40 Running test SimulStop (cts0202) [ 1]<br>
Jan 27 15:53:39 Running test NearQuorumPoint (cts0202) [ 2]<br>Jan 27 15:55:34 Running test ComponentFail (cts0201) [ 3]<br>Jan 27 15:57:40 Running test Reattach (cts0202) [ 4]<br>
Jan 27 16:02:35 Running test SimulStop (cts0201) [ 5]<br>Jan 27 16:03:26 Running test SpecialTest1 (cts0201) [ 6]<br>Jan 27 16:06:19 Running test ComponentFail (cts0201) [ 7]<br>
Jan 27 16:07:17 Running test SpecialTest1 (cts0201) [ 8]<br>Jan 27 16:10:47 Running test ComponentFail (cts0201) [ 9]<br>Jan 27 16:11:42 BadNews: Jan 27 16:11:03 cts0201 crmd: [23399]: ERROR: stonithd_op_result_ready: not signed on<br>
Jan 27 16:11:45 Running test ResourceRecover (cts0202) [ 10]<br>Jan 27 16:11:46 No active resources on cts0202<br>Jan 27 16:12:03 Stopping Cluster Manager on all nodes<br>Jan 27 16:12:03 Stopping crm-flatiron on node cts0201<br>
Jan 27 16:12:26 Stopping crm-flatiron on node cts0202<br>Jan 27 16:13:09 ****************<br>Jan 27 16:13:09 Overall Results:{'failure': 0, 'skipped': 0, 'success': 10, 'BadNews': 1}<br>Jan 27 16:13:09 ****************<br>
Jan 27 16:13:09 Test Summary<br>Jan 27 16:13:09 Test Flip: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 0}<br>Jan 27 16:13:09 Test Restart: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 0}<br>
Jan 27 16:13:09 Test StartOnebyOne: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 0}<br>Jan 27 16:13:09 Test SimulStart: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 0}<br>
Jan 27 16:13:09 Test SimulStop: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 2}<br>Jan 27 16:13:09 Test StopOnebyOne: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 0}<br>
Jan 27 16:13:09 Test RestartOnebyOne: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 0}<br>Jan 27 16:13:09 Test PartialStart: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 0}<br>
Jan 27 16:13:09 Test Standby: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 0}<br>Jan 27 16:13:09 Test ResourceRecover: {'auditfail': 0, 'failure': 0, 'skipped': 1, 'calls': 1}<br>
Jan 27 16:13:09 Test ComponentFail: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 3}<br>Jan 27 16:13:09 Test Reattach: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 1}<br>
Jan 27 16:13:09 Test SpecialTest1: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 2}<br>Jan 27 16:13:09 Test NearQuorumPoint: {'auditfail': 0, 'failure': 0, 'skipped': 0, 'calls': 1}<br>
Jan 27 16:13:09 <<<<<<<<<<<<<<<< TESTS COMPLETED<br>-----<br><br> The URL to take into account is as follows.<br> <a href="http://www.clusterlabs.org/wiki/Release_Testing" target="_blank">http://www.clusterlabs.org/wiki/Release_Testing</a><br>
<br>Regards,<br>Tomo<br><br><div class="gmail_quote">2011年1月26日20:01 nozawat <span dir="ltr"><<a href="mailto:nozawat@gmail.com" target="_blank">nozawat@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
Hi Andrew<br><br> Where is filename of cts_log_watcher.py set?<br> cts_log_watcher is made by /tmp, but filename of this inside seems not to be changed by /var/log/messages.<br> Or <span></span>filename seems not to be handed by CTSlab.py.<br>
<br>Regards,<br>Tomo<br><br><div class="gmail_quote">
2011年1月22日11:15 nozawat <span dir="ltr"><<a href="mailto:nozawat@gmail.com" target="_blank">nozawat@gmail.com</a>></span>:<div><div></div><div><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div>Hi<br><br> Thank you for your reply.<br></div> I stopped a script in "CTL+C" after "Audit LogAudit FAILED" was output.<br> * bbs01-console.log -> central server console log<br> * ha-log-local7-bbs01 -> central server<br>
* ha-log-local7-cts0101 -> cts server 1<br> * ha-log-local7-cts0102 -> cts server 2<br><br> The real file name of the server log is ha-log-local7.<br> I renamed a file name to send it by an email.<br> They are made with all servers by /share/ha/logs subordinates.<br>
<br> BTW, a file is made in /tmp.<br> Don't you have any problem in authority below?<br>---<br>[11:14:23][root@bbs01 ~]$ ll /tmp<br>-rw-r--r-- 1 root root 1612 1月 22 10:44 cts_log_watcher.py<br>[11:12:39][root@cts0101 ~]$ ll /tmp<br>
-rw-r--r-- 1 root root 1612 1月 22 10:44 cts_log_watcher.py<br>[11:13:36][root@cts0102 ~]$ ll /tmp<br>-rw-r--r-- 1 root root 1612 1月 22 10:44 cts_log_watcher.py<br>---<br><br>Regards,<br>Tomo<br><br><div class="gmail_quote">
2011/1/22 Andrew Beekhof <span dir="ltr"><<a href="mailto:andrew@beekhof.net" target="_blank">andrew@beekhof.net</a>></span><div><div></div><div><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div>On Fri, Jan 21, 2011 at 4:38 PM, nozawat <<a href="mailto:nozawat@gmail.com" target="_blank">nozawat@gmail.com</a>> wrote:<br>
> Hi<br>
><br>
</div><div>> Thank you for your reply.<br>
> I logging with central server and both running CTS server.<br>
> A test message is output by both central server and running CTS server.<br>
<br>
</div>Can we see it please?<br>
<div><div></div><div><br>
><br>
> Regards,<br>
> Tomo<br>
><br>
> 2011/1/21 Andrew Beekhof <<a href="mailto:andrew@beekhof.net" target="_blank">andrew@beekhof.net</a>><br>
>><br>
>> On Fri, Jan 21, 2011 at 6:03 AM, nozawat <<a href="mailto:nozawat@gmail.com" target="_blank">nozawat@gmail.com</a>> wrote:<br>
>> > Hi<br>
>> ><br>
>> > I ran CTS in the following environment.<br>
>> > * OS:RHEL5.5-x86_64<br>
>> > * pacemaker-1.0.9.1-1.15.el5<br>
>> > * TDN(bbs01)<br>
>> > * TNNs(cts0101 cts0102)<br>
>> ><br>
>> > Probably it is a phenomenon like the following.<br>
>> > <a href="http://www.gossamer-threads.com/lists/linuxha/pacemaker/69322" target="_blank">http://www.gossamer-threads.com/lists/linuxha/pacemaker/69322</a><br>
>> ><br>
>> > SSH login without password -> OK.<br>
>> > Syslog Message transfer by syslog-ng -> OK.<br>
>><br>
>> You're logging to a central server? The same server you're running CTS<br>
>> on?<br>
>> If so, what is the contents of /share/ha/logs/ha-log-local7 on that<br>
>> machine? Because that is where CTS is looking.<br>
>><br>
>> ><br>
>> > -------<br>
>> > $ python /usr/share/pacemaker/tests/cts/CTSlab.py --nodes "cts0101<br>
>> > cts0102"<br>
>> > --at-boot 1 --stack heartbeat --stonith no --logfile<br>
>> > /share/ha/logs/ha-log-local7 --syslog-facility local7 1<br>
>> > Jan 21 13:23:08 Random seed is: 1295583788<br>
>> > Jan 21 13:23:08 >>>>>>>>>>>>>>>> BEGINNING 1 TESTS<br>
>> > Jan 21 13:23:08 Stack: heartbeat<br>
>> > Jan 21 13:23:08 Schema: pacemaker-1.0<br>
>> > Jan 21 13:23:08 Scenario: Random Test Execution<br>
>> > Jan 21 13:23:08 Random Seed: 1295583788<br>
>> > Jan 21 13:23:08 System log files: /share/ha/logs/ha-log-local7<br>
>> > Jan 21 13:23:08 Cluster nodes:<br>
>> > Jan 21 13:23:08 * cts0101<br>
>> > Jan 21 13:23:08 * cts0102<br>
>> > Jan 21 13:23:12 Testing for syslog logs<br>
>> > Jan 21 13:23:12 Testing for remote logs<br>
>> > Jan 21 13:24:16 Restarting logging on: ['cts0101', 'cts0102']<br>
>> > Jan 21 13:25:49 Restarting logging on: ['cts0101', 'cts0102']<br>
>> > Jan 21 13:28:21 Restarting logging on: ['cts0101', 'cts0102']<br>
>> > Jan 21 13:31:54 Restarting logging on: ['cts0101', 'cts0102']<br>
>> > Jan 21 13:35:54 ERROR: Cluster logging unrecoverable.<br>
>> > Jan 21 13:35:54 Audit LogAudit FAILED.<br>
>> > -----<br>
>> ><br>
>> > I run it in heartbeat, but a similar error occurs in corosync.<br>
>> > I become the error in "Single search timed out" in the log and seem to<br>
>> > retry.<br>
>> > -----<br>
>> > Jan 21 13:23:11 bbs01 CTS: debug: Audit DiskspaceAudit passed.<br>
>> > Jan 21 13:23:12 bbs01 CTS: Testing for syslog logs<br>
>> > Jan 21 13:23:12 bbs01 CTS: Testing for remote logs<br>
>> > Jan 21 13:23:12 bbs01 CTS: debug: lw:<br>
>> > cts0101:/share/ha/logs/ha-log-local7:<br>
>> > Installing /tmp/cts_log_watcher.py on cts0101<br>
>> > Jan 21 13:23:12 bbs01 CTS: debug: lw:<br>
>> > cts0102:/share/ha/logs/ha-log-local7:<br>
>> > Installing /tmp/cts_log_watcher.py on cts0102<br>
>> > Jan 21 13:23:13 cts0102 logger: Test message from cts0102<br>
>> > Jan 21 13:23:13 cts0101 logger: Test message from cts0101<br>
>> > Jan 21 13:23:44 bbs01 CTS: debug: lw: LogAudit: Single search timed out:<br>
>> > timeout=30, start=1295583793, limit=1295583824, now=1295583824<br>
>> > Jan 21 13:24:16 bbs01 CTS: debug: lw: LogAudit: Single search timed out:<br>
>> > timeout=30, start=1295583824, limit=1295583855, now=1295583856<br>
>> > Jan 21 13:24:16 bbs01 CTS: Restarting logging on: ['cts0101', 'cts0102']<br>
>> > Jan 21 13:24:16 bbs01 CTS: debug: cmd: async: target=cts0101, rc=22203:<br>
>> > /etc/init.d/syslog-ng restart 2>&1 > /dev/null<br>
>> > Jan 21 13:24:16 bbs01 CTS: debug: cmd: async: target=cts0102, rc=22204:<br>
>> > /etc/init.d/syslog-ng restart 2>&1 > /dev/null<br>
>> > Jan 21 13:25:17 cts0102 logger: Test message from cts0102<br>
>> > Jan 21 13:25:17 cts0101 logger: Test message from cts0101<br>
>> > -----<br>
>> ><br>
>> > The test case seems to be carried out after this error.<br>
>> > However, the script is finished by an error. It is because "Audit<br>
>> > LogAudit<br>
>> > FAILED" occurs.<br>
>> > Is it right that how becomes the result of the CTS?<br>
>> ><br>
>> > Regards,<br>
>> > Tomo<br>
>> ><br>
>> ><br>
>> > _______________________________________________<br>
>> > Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org" target="_blank">Pacemaker@oss.clusterlabs.org</a><br>
>> > <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
>> ><br>
>> > Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
>> > Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
>> > Bugs:<br>
>> ><br>
>> > <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
>> ><br>
>> ><br>
>><br>
>> _______________________________________________<br>
>> Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org" target="_blank">Pacemaker@oss.clusterlabs.org</a><br>
>> <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
>><br>
>> Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
>> Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
>> Bugs:<br>
>> <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
><br>
><br>
> _______________________________________________<br>
> Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org" target="_blank">Pacemaker@oss.clusterlabs.org</a><br>
> <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
><br>
> Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
> Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
> Bugs:<br>
> <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
><br>
><br>
<br>
_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org" target="_blank">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
</div></div></blockquote></div></div></div><br>
</blockquote></div></div></div><br>
</blockquote></div><br>