Feb 22 19:20:07 bob cib: [2256]: info: cib_stats: Processed 1 operations (20000.00us average, 0% utilization) in the last 10min
Feb 24 14:32:14 alice syslogd 1.4.1: restart.
Feb 24 14:32:14 alice kernel: klogd 1.4.1, log source = /proc/kmsg started.
Feb 24 14:32:14 alice kernel: Linux version 2.6.18-164.11.1.el5 (mockbuild@builder16.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Wed Jan 20 07:39:04 EST 2010
Feb 24 14:32:14 alice kernel: BIOS-provided physical RAM map:
Feb 24 14:32:14 alice kernel:  BIOS-e820: 0000000000010000 - 000000000009f000 (usable)
Feb 24 14:32:14 alice kernel:  BIOS-e820: 000000000009f000 - 00000000000a0000 (reserved)
Feb 24 14:32:14 alice kernel:  BIOS-e820: 00000000000e8000 - 0000000000100000 (reserved)
Feb 24 14:32:14 alice kernel:  BIOS-e820: 0000000000100000 - 000000001fff0000 (usable)
Feb 24 14:32:14 alice kernel:  BIOS-e820: 000000001fff0000 - 0000000020000000 (ACPI data)
Feb 24 14:32:14 alice kernel:  BIOS-e820: 00000000fffbc000 - 0000000100000000 (reserved)
Feb 24 14:32:14 alice kernel: 0MB HIGHMEM available.
Feb 24 14:32:14 alice kernel: 511MB LOWMEM available.
Feb 24 14:32:14 alice kernel: found SMP MP-table at 000fbc90
Feb 24 14:32:14 alice kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Feb 24 14:32:14 alice kernel: disabling kdump
Feb 24 14:32:14 alice kernel: Using x86 segment limits to approximate NX protection
Feb 24 14:32:14 alice kernel: DMI 2.4 present.
Feb 24 14:32:14 alice kernel: kvm-clock: cpu 0, msr 0:7399e1, boot clock
Feb 24 14:32:14 alice kernel: Using APIC driver default
Feb 24 14:32:15 alice kernel: ACPI: PM-Timer IO Port: 0xb008
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Feb 24 14:32:15 alice kernel: Processor #0 6:3 APIC version 20
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0c] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0d] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x0e] disabled)
Feb 24 14:32:15 alice kernel: ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x0f] disabled)
Feb 24 14:32:15 alice kernel: ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
Feb 24 14:32:15 alice kernel: IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
Feb 24 14:32:15 alice kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
Feb 24 14:32:15 alice kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
Feb 24 14:32:15 alice kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Feb 24 14:32:15 alice kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
Feb 24 14:32:15 alice kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
Feb 24 14:32:15 alice kernel: Enabling APIC mode:  Flat.  Using 1 I/O APICs
Feb 24 14:32:15 alice kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000
Feb 24 14:32:15 alice kernel: Using ACPI (MADT) for SMP configuration information
Feb 24 14:32:15 alice kernel: Allocating PCI resources starting at 30000000 (gap: 20000000:dffbc000)
Feb 24 14:32:15 alice kernel: TSC: Frequency read from the hypervisor
Feb 24 14:32:15 alice kernel: Detected 2327.426 MHz processor.
Feb 24 14:32:15 alice kernel: kvm-clock: cpu 0, msr 0:1404361, primary cpu clock
Feb 24 14:32:15 alice kernel: Built 1 zonelists.  Total pages: 131056
Feb 24 14:32:15 alice kernel: Kernel command line: ro root=LABEL=/
Feb 24 14:32:15 alice kernel: Enabling fast FPU save and restore... done.
Feb 24 14:32:15 alice kernel: Enabling unmasked SIMD FPU exception support... done.
Feb 24 14:32:15 alice kernel: Initializing CPU#0
Feb 24 14:32:15 alice kernel: CPU 0 irqstacks, hard=c0762000 soft=c0742000
Feb 24 14:32:15 alice kernel: PID hash table entries: 2048 (order: 11, 8192 bytes)
Feb 24 14:32:15 alice kernel: Console: colour VGA+ 80x25
Feb 24 14:32:15 alice kernel: Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Feb 24 14:32:15 alice kernel: Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Feb 24 14:32:15 alice kernel: Memory: 512464k/524224k available (2161k kernel code, 11164k reserved, 901k data, 228k init, 0k highmem)
Feb 24 14:32:15 alice kernel: Checking if this processor honours the WP bit even in supervisor mode... Ok.
Feb 24 14:32:15 alice kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 4654.85 BogoMIPS (lpj=2327426)
Feb 24 14:32:15 alice kernel: Security Framework v1.0.0 initialized
Feb 24 14:32:15 alice kernel: SELinux:  Initializing.
Feb 24 14:32:15 alice kernel: selinux_register_security:  Registering secondary module capability
Feb 24 14:32:15 alice kernel: Capability LSM initialized as secondary
Feb 24 14:32:15 alice kernel: Mount-cache hash table entries: 512
Feb 24 14:32:15 alice kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Feb 24 14:32:15 alice kernel: CPU: L2 cache: 2048K
Feb 24 14:32:15 alice kernel: kvm-clock: cpu 0, msr 0:1404361, boot clock
Feb 24 14:32:15 alice kernel: register_clocksource: Cannot register kvm-clock. Already registered!<6>Checking 'hlt' instruction... OK.
Feb 24 14:32:15 alice kernel: SMP alternatives: switching to UP code
Feb 24 14:32:15 alice kernel: Freeing SMP alternatives: 14k freed
Feb 24 14:32:15 alice kernel: ACPI: Core revision 20060707
Feb 24 14:32:15 alice kernel: CPU0: Intel Pentium II (Klamath) stepping 03
Feb 24 14:32:15 alice kernel: Total of 1 processors activated (4654.85 BogoMIPS).
Feb 24 14:32:15 alice kernel: ENABLING IO-APIC IRQs
Feb 24 14:32:15 alice kernel: ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
Feb 24 14:32:15 alice kernel: Using local APIC timer interrupts.
Feb 24 14:32:15 alice kernel: WARNING calibrate_APIC_clock: the APIC timer calibration may be wrong.
Feb 24 14:32:15 alice kernel: Brought up 1 CPUs
Feb 24 14:32:15 alice kernel: checking if image is initramfs... it is
Feb 24 14:32:15 alice kernel: Freeing initrd memory: 2486k freed
Feb 24 14:32:15 alice rpc.statd[1801]: Version 1.0.9 Starting
Feb 24 14:32:15 alice kernel: NET: Registered protocol family 16
Feb 24 14:32:15 alice kernel: ACPI: bus type pci registered
Feb 24 14:32:15 alice kernel: PCI: PCI BIOS revision 2.10 entry at 0xfb490, last bus=0
Feb 24 14:32:15 alice kernel: PCI: Using configuration type 1
Feb 24 14:32:15 alice kernel: Setting up standard PCI resources
Feb 24 14:32:15 alice kernel: ACPI: Interpreter enabled
Feb 24 14:32:15 alice kernel: ACPI: Using IOAPIC for interrupt routing
Feb 24 14:32:15 alice kernel: ACPI: No dock devices found.
Feb 24 14:32:15 alice kernel: ACPI: PCI Root Bridge [PCI0] (0000:00)
Feb 24 14:32:15 alice kernel: PCI quirk: region b000-b03f claimed by PIIX4 ACPI
Feb 24 14:32:15 alice kernel: PCI quirk: region b100-b10f claimed by PIIX4 SMB
Feb 24 14:32:16 alice kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
Feb 24 14:32:16 alice kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
Feb 24 14:32:16 alice kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
Feb 24 14:32:16 alice kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
Feb 24 14:32:16 alice kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Feb 24 14:32:16 alice kernel: pnp: PnP ACPI init
Feb 24 14:32:16 alice kernel: pnp: PnP ACPI: found 5 devices
Feb 24 14:32:16 alice kernel: usbcore: registered new driver usbfs
Feb 24 14:32:16 alice kernel: usbcore: registered new driver hub
Feb 24 14:32:16 alice rpc.statd[1801]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user 
Feb 24 14:32:16 alice kernel: PCI: Using ACPI for IRQ routing
Feb 24 14:32:16 alice kernel: PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report
Feb 24 14:32:16 alice kernel: NetLabel: Initializing
Feb 24 14:32:16 alice kernel: NetLabel:  domain hash size = 128
Feb 24 14:32:16 alice kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Feb 24 14:32:16 alice kernel: NetLabel:  unlabeled traffic allowed by default
Feb 24 14:32:16 alice kernel: NET: Registered protocol family 2
Feb 24 14:32:16 alice kernel: IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
Feb 24 14:32:16 alice kernel: TCP established hash table entries: 16384 (order: 5, 131072 bytes)
Feb 24 14:32:16 bob syslogd 1.4.1: restart.
Feb 24 14:32:16 bob kernel: klogd 1.4.1, log source = /proc/kmsg started.
Feb 24 14:32:16 bob kernel: Linux version 2.6.18-164.11.1.el5 (mockbuild@builder16.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Wed Jan 20 07:39:04 EST 2010
Feb 24 14:32:16 bob kernel: BIOS-provided physical RAM map:
Feb 24 14:32:16 bob kernel:  BIOS-e820: 0000000000010000 - 000000000009f000 (usable)
Feb 24 14:32:16 bob kernel:  BIOS-e820: 000000000009f000 - 00000000000a0000 (reserved)
Feb 24 14:32:16 bob kernel:  BIOS-e820: 00000000000e8000 - 0000000000100000 (reserved)
Feb 24 14:32:16 bob kernel:  BIOS-e820: 0000000000100000 - 000000001fff0000 (usable)
Feb 24 14:32:16 bob kernel:  BIOS-e820: 000000001fff0000 - 0000000020000000 (ACPI data)
Feb 24 14:32:16 bob kernel:  BIOS-e820: 00000000fffbc000 - 0000000100000000 (reserved)
Feb 24 14:32:16 bob kernel: 0MB HIGHMEM available.
Feb 24 14:32:16 bob kernel: 511MB LOWMEM available.
Feb 24 14:32:16 bob kernel: found SMP MP-table at 000fbc90
Feb 24 14:32:16 bob kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Feb 24 14:32:16 bob kernel: disabling kdump
Feb 24 14:32:17 alice kernel: TCP bind hash table entries: 8192 (order: 4, 65536 bytes)
Feb 24 14:32:17 alice kernel: TCP: Hash tables configured (established 16384 bind 8192)
Feb 24 14:32:17 alice kernel: TCP reno registered
Feb 24 14:32:17 alice kernel: apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
Feb 24 14:32:17 alice kernel: apm: overridden by ACPI.
Feb 24 14:32:17 alice kernel: audit: initializing netlink socket (disabled)
Feb 24 14:32:17 alice kernel: type=2000 audit(1267018272.736:1): initialized
Feb 24 14:32:17 alice kernel: Total HugeTLB memory allocated, 0
Feb 24 14:32:17 alice kernel: VFS: Disk quotas dquot_6.5.1
Feb 24 14:32:17 alice kernel: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Feb 24 14:32:17 alice kernel: Initializing Cryptographic API
Feb 24 14:32:17 alice kernel: alg: No test for crc32c (crc32c-generic)
Feb 24 14:32:17 alice kernel: ksign: Installing public key data
Feb 24 14:32:17 alice kernel: Loading keyring
Feb 24 14:32:17 alice kernel: - Added public key 77280CF9B461AFBC
Feb 24 14:32:17 alice kernel: - User ID: CentOS (Kernel Module GPG key)
Feb 24 14:32:17 alice kernel: io scheduler noop registered
Feb 24 14:32:17 alice kernel: io scheduler anticipatory registered
Feb 24 14:32:17 alice kernel: io scheduler deadline registered
Feb 24 14:32:17 alice kernel: io scheduler cfq registered (default)
Feb 24 14:32:17 alice kernel: Limiting direct PCI/PCI transfers.
Feb 24 14:32:17 alice kernel: PCI: PIIX3: Enabling Passive Release on 0000:00:01.0
Feb 24 14:32:17 alice kernel: Activating ISA DMA hang workarounds.
Feb 24 14:32:17 alice kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Feb 24 14:32:17 alice kernel: Real Time Clock Driver v1.12ac
Feb 24 14:32:17 alice kernel: Non-volatile memory driver v1.2
Feb 24 14:32:17 alice kernel: Linux agpgart interface v0.101 (c) Dave Jones
Feb 24 14:32:17 alice kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Feb 24 14:32:17 alice kernel: brd: module loaded
Feb 24 14:32:17 alice kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Feb 24 14:32:17 alice kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Feb 24 14:32:17 alice kernel: PIIX3: IDE controller at PCI slot 0000:00:01.1
Feb 24 14:32:17 alice kernel: PIIX3: chipset revision 0
Feb 24 14:32:17 alice kernel: PIIX3: not 100% native mode: will probe irqs later
Feb 24 14:32:17 alice kernel:     ide0: BM-DMA at 0xc000-0xc007, BIOS settings: hda:pio, hdb:pio
Feb 24 14:32:17 alice kernel:     ide1: BM-DMA at 0xc008-0xc00f, BIOS settings: hdc:pio, hdd:pio
Feb 24 14:32:17 bob kernel: Using x86 segment limits to approximate NX protection
Feb 24 14:32:17 bob kernel: DMI 2.4 present.
Feb 24 14:32:17 bob kernel: kvm-clock: cpu 0, msr 0:7399e1, boot clock
Feb 24 14:32:17 bob kernel: Using APIC driver default
Feb 24 14:32:17 bob kernel: ACPI: PM-Timer IO Port: 0xb008
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Feb 24 14:32:17 bob kernel: Processor #0 6:3 APIC version 20
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0c] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0d] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x0e] disabled)
Feb 24 14:32:17 bob kernel: ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x0f] disabled)
Feb 24 14:32:17 bob kernel: ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
Feb 24 14:32:17 bob kernel: IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
Feb 24 14:32:17 bob kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
Feb 24 14:32:17 bob kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
Feb 24 14:32:17 bob kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Feb 24 14:32:17 bob kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
Feb 24 14:32:17 bob kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
Feb 24 14:32:18 alice kernel: hdc: QEMU DVD-ROM, ATAPI CD/DVD-ROM drive
Feb 24 14:32:18 alice kernel: ide1 at 0x170-0x177,0x376 on irq 15
Feb 24 14:32:18 alice kernel: ide-floppy driver 0.99.newide
Feb 24 14:32:18 alice kernel: usbcore: registered new driver hiddev
Feb 24 14:32:18 alice kernel: usbcore: registered new driver usbhid
Feb 24 14:32:18 alice kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver
Feb 24 14:32:18 alice kernel: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
Feb 24 14:32:18 alice kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Feb 24 14:32:18 alice kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Feb 24 14:32:18 alice kernel: mice: PS/2 mouse device common for all mice
Feb 24 14:32:18 alice kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Feb 24 14:32:18 alice kernel: md: bitmap version 4.39
Feb 24 14:32:18 alice kernel: TCP bic registered
Feb 24 14:32:18 alice kernel: Initializing IPsec netlink socket
Feb 24 14:32:18 alice kernel: NET: Registered protocol family 1
Feb 24 14:32:18 alice kernel: NET: Registered protocol family 17
Feb 24 14:32:17 alice hcid[1869]: Bluetooth HCI daemon
Feb 24 14:32:18 alice kernel: Using IPI No-Shortcut mode
Feb 24 14:32:18 alice kernel: ACPI: (supports S3<6>Time: kvm-clock clocksource has been installed.
Feb 24 14:32:18 alice kernel:  S4 S5)
Feb 24 14:32:18 alice kernel: Initalizing network drop monitor service
Feb 24 14:32:18 alice kernel: Freeing unused kernel memory: 228k freed
Feb 24 14:32:18 alice kernel: Write protecting the kernel read-only data: 405k
Feb 24 14:32:18 alice kernel: input: AT Translated Set 2 keyboard as /class/input/input0
Feb 24 14:32:18 alice kernel: input: ImExPS/2 Generic Explorer Mouse as /class/input/input1
Feb 24 14:32:18 alice kernel: USB Universal Host Controller Interface driver v3.0
Feb 24 14:32:18 alice hcid[1869]: Register path:/org/bluez fallback:1
Feb 24 14:32:18 alice kernel: ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
Feb 24 14:32:18 alice sdpd[1873]: Bluetooth SDP daemon 
Feb 24 14:32:18 alice kernel: ACPI: PCI Interrupt 0000:00:01.2[D] -> Link [LNKD] -> GSI 11 (level, high) -> IRQ 11
Feb 24 14:32:18 bob kernel: Enabling APIC mode:  Flat.  Using 1 I/O APICs
Feb 24 14:32:18 bob kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000
Feb 24 14:32:18 bob kernel: Using ACPI (MADT) for SMP configuration information
Feb 24 14:32:18 bob kernel: Allocating PCI resources starting at 30000000 (gap: 20000000:dffbc000)
Feb 24 14:32:18 bob kernel: TSC: Frequency read from the hypervisor
Feb 24 14:32:18 bob kernel: Detected 2327.426 MHz processor.
Feb 24 14:32:18 bob kernel: kvm-clock: cpu 0, msr 0:1404361, primary cpu clock
Feb 24 14:32:18 bob kernel: Built 1 zonelists.  Total pages: 131056
Feb 24 14:32:18 bob kernel: Kernel command line: ro root=LABEL=/
Feb 24 14:32:18 bob kernel: Enabling fast FPU save and restore... done.
Feb 24 14:32:18 bob kernel: Enabling unmasked SIMD FPU exception support... done.
Feb 24 14:32:18 bob kernel: Initializing CPU#0
Feb 24 14:32:18 bob kernel: CPU 0 irqstacks, hard=c0762000 soft=c0742000
Feb 24 14:32:18 bob kernel: PID hash table entries: 2048 (order: 11, 8192 bytes)
Feb 24 14:32:18 bob rpc.statd[1799]: Version 1.0.9 Starting
Feb 24 14:32:18 bob kernel: Console: colour VGA+ 80x25
Feb 24 14:32:18 bob kernel: Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Feb 24 14:32:18 bob kernel: Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Feb 24 14:32:18 bob kernel: Memory: 512464k/524224k available (2161k kernel code, 11164k reserved, 901k data, 228k init, 0k highmem)
Feb 24 14:32:18 bob kernel: Checking if this processor honours the WP bit even in supervisor mode... Ok.
Feb 24 14:32:18 bob kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 4654.85 BogoMIPS (lpj=2327426)
Feb 24 14:32:18 bob kernel: Security Framework v1.0.0 initialized
Feb 24 14:32:18 bob kernel: SELinux:  Initializing.
Feb 24 14:32:18 bob kernel: selinux_register_security:  Registering secondary module capability
Feb 24 14:32:18 bob kernel: Capability LSM initialized as secondary
Feb 24 14:32:18 bob kernel: Mount-cache hash table entries: 512
Feb 24 14:32:18 bob kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Feb 24 14:32:18 bob kernel: CPU: L2 cache: 2048K
Feb 24 14:32:18 bob rpc.statd[1799]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user 
Feb 24 14:32:18 bob kernel: kvm-clock: cpu 0, msr 0:1404361, boot clock
Feb 24 14:32:19 alice kernel: uhci_hcd 0000:00:01.2: UHCI Host Controller
Feb 24 14:32:19 alice kernel: uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
Feb 24 14:32:19 alice kernel: uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020
Feb 24 14:32:19 alice kernel: usb usb1: configuration #1 chosen from 1 choice
Feb 24 14:32:19 alice kernel: hub 1-0:1.0: USB hub found
Feb 24 14:32:19 alice kernel: hub 1-0:1.0: 2 ports detected
Feb 24 14:32:19 alice kernel: ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10
Feb 24 14:32:19 alice kernel: ACPI: PCI Interrupt 0000:00:03.0[A] -> Link [LNKC] -> GSI 10 (level, high) -> IRQ 10
Feb 24 14:32:19 alice kernel: ACPI: PCI Interrupt 0000:00:04.0[A] -> Link [LNKD] -> GSI 11 (level, high) -> IRQ 11
Feb 24 14:32:19 alice kernel: ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
Feb 24 14:32:19 alice kernel: ACPI: PCI Interrupt 0000:00:05.0[A] -> Link [LNKA] -> GSI 10 (level, high) -> IRQ 10
Feb 24 14:32:19 alice kernel: ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 11
Feb 24 14:32:19 alice kernel: ACPI: PCI Interrupt 0000:00:06.0[A] -> Link [LNKB] -> GSI 11 (level, high) -> IRQ 11
Feb 24 14:32:19 alice kernel: ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [LNKC] -> GSI 10 (level, high) -> IRQ 10
Feb 24 14:32:19 alice kernel:  vda: vda1 vda2
Feb 24 14:32:19 alice kernel:  vdb: vdb1 vdb2 vdb3
Feb 24 14:32:19 alice kernel: SCSI subsystem initialized
Feb 24 14:32:19 alice kernel: device-mapper: uevent: version 1.0.3
Feb 24 14:32:19 alice kernel: device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@redhat.com
Feb 24 14:32:19 alice kernel: device-mapper: dm-raid45: initialized v0.2594l
Feb 24 14:32:19 alice kernel: EXT3-fs: INFO: recovery required on readonly filesystem.
Feb 24 14:32:19 alice kernel: EXT3-fs: write access will be enabled during recovery.
Feb 24 14:32:19 alice kernel: kjournald starting.  Commit interval 5 seconds
Feb 24 14:32:19 alice kernel: EXT3-fs: vda1: orphan cleanup on readonly fs
Feb 24 14:32:19 alice kernel: EXT3-fs: vda1: 5 orphan inodes deleted
Feb 24 14:32:19 alice kernel: EXT3-fs: recovery complete.
Feb 24 14:32:19 alice kernel: EXT3-fs: mounted filesystem with ordered data mode.
Feb 24 14:32:19 alice kernel: SELinux:  Disabled at runtime.
Feb 24 14:32:19 alice kernel: type=1404 audit(1267018301.207:2): selinux=0 auid=4294967295 ses=4294967295
Feb 24 14:32:19 alice kernel: hdc: ATAPI 4X CD-ROM drive, 512kB Cache, (U)DMA
Feb 24 14:32:19 alice kernel: Uniform CD-ROM driver Revision: 3.20
Feb 24 14:32:19 alice kernel: input: PC Speaker as /class/input/input2
Feb 24 14:32:19 alice kernel: piix4_smbus 0000:00:01.3: Found 0000:00:01.3 device
Feb 24 14:32:19 alice kernel: FDC 0 is a S82078B
Feb 24 14:32:19 alice kernel: lp: driver loaded but no devices found
Feb 24 14:32:19 alice kernel: ACPI: Power Button (FF) [PWRF]
Feb 24 14:32:19 alice pcscd: pcscdaemon.c:507:main() pcsc-lite 1.4.4 daemon ready.
Feb 24 14:32:19 alice kernel: md: Autodetecting RAID arrays.
Feb 24 14:32:19 bob kernel: register_clocksource: Cannot register kvm-clock. Already registered!<6>Checking 'hlt' instruction... OK.
Feb 24 14:32:19 bob kernel: SMP alternatives: switching to UP code
Feb 24 14:32:19 bob kernel: Freeing SMP alternatives: 14k freed
Feb 24 14:32:19 bob kernel: ACPI: Core revision 20060707
Feb 24 14:32:19 bob kernel: CPU0: Intel Pentium II (Klamath) stepping 03
Feb 24 14:32:19 bob kernel: Total of 1 processors activated (4654.85 BogoMIPS).
Feb 24 14:32:19 bob kernel: ENABLING IO-APIC IRQs
Feb 24 14:32:19 bob kernel: ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
Feb 24 14:32:19 bob kernel: Using local APIC timer interrupts.
Feb 24 14:32:19 bob kernel: WARNING calibrate_APIC_clock: the APIC timer calibration may be wrong.
Feb 24 14:32:19 bob kernel: Brought up 1 CPUs
Feb 24 14:32:19 bob kernel: checking if image is initramfs... it is
Feb 24 14:32:19 bob kernel: Freeing initrd memory: 2486k freed
Feb 24 14:32:19 bob kernel: NET: Registered protocol family 16
Feb 24 14:32:19 bob kernel: ACPI: bus type pci registered
Feb 24 14:32:19 bob kernel: PCI: PCI BIOS revision 2.10 entry at 0xfb490, last bus=0
Feb 24 14:32:19 bob kernel: PCI: Using configuration type 1
Feb 24 14:32:19 bob kernel: Setting up standard PCI resources
Feb 24 14:32:19 bob kernel: ACPI: Interpreter enabled
Feb 24 14:32:19 bob kernel: ACPI: Using IOAPIC for interrupt routing
Feb 24 14:32:19 bob kernel: ACPI: No dock devices found.
Feb 24 14:32:19 bob kernel: ACPI: PCI Root Bridge [PCI0] (0000:00)
Feb 24 14:32:19 bob kernel: PCI quirk: region b000-b03f claimed by PIIX4 ACPI
Feb 24 14:32:19 bob kernel: PCI quirk: region b100-b10f claimed by PIIX4 SMB
Feb 24 14:32:19 bob kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
Feb 24 14:32:19 bob kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
Feb 24 14:32:19 bob kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
Feb 24 14:32:19 bob kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
Feb 24 14:32:19 bob kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Feb 24 14:32:19 bob kernel: pnp: PnP ACPI init
Feb 24 14:32:19 bob kernel: pnp: PnP ACPI: found 5 devices
Feb 24 14:32:19 bob kernel: usbcore: registered new driver usbfs
Feb 24 14:32:19 bob kernel: usbcore: registered new driver hub
Feb 24 14:32:19 bob kernel: PCI: Using ACPI for IRQ routing
Feb 24 14:32:19 bob kernel: PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report
Feb 24 14:32:19 bob kernel: NetLabel: Initializing
Feb 24 14:32:19 bob kernel: NetLabel:  domain hash size = 128
Feb 24 14:32:19 bob kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Feb 24 14:32:19 bob kernel: NetLabel:  unlabeled traffic allowed by default
Feb 24 14:32:19 bob kernel: NET: Registered protocol family 2
Feb 24 14:32:20 alice kernel: md: autorun ...
Feb 24 14:32:20 alice kernel: md: ... autorun DONE.
Feb 24 14:32:20 alice kernel: device-mapper: multipath: version 1.0.5 loaded
Feb 24 14:32:20 alice kernel: EXT3 FS on vda1, internal journal
Feb 24 14:32:20 alice kernel: Adding 522104k swap on /dev/vda2.  Priority:-1 extents:1 across:522104k
Feb 24 14:32:20 alice kernel: IA-32 Microcode Update Driver: v1.14a <tigran@veritas.com>
Feb 24 14:32:20 alice kernel: microcode: CPU0 updated from revision 0x0 to 0x0, date = 09231998 
Feb 24 14:32:20 alice kernel: NET: Registered protocol family 10
Feb 24 14:32:20 alice kernel: lo: Disabled Privacy Extensions
Feb 24 14:32:20 alice kernel: IPv6 over IPv4 tunneling driver
Feb 24 14:32:20 alice kernel: process `sysctl' is using deprecated sysctl (syscall) net.ipv6.neigh.lo.base_reachable_time; Use net.ipv6.neigh.lo.base_reachable_time_ms instead.
Feb 24 14:32:20 alice kernel: Bluetooth: Core ver 2.10
Feb 24 14:32:20 alice kernel: NET: Registered protocol family 31
Feb 24 14:32:20 alice kernel: Bluetooth: HCI device and connection manager initialized
Feb 24 14:32:20 alice kernel: Bluetooth: HCI socket layer initialized
Feb 24 14:32:20 alice kernel: Bluetooth: L2CAP ver 2.8
Feb 24 14:32:20 alice kernel: Bluetooth: L2CAP socket layer initialized
Feb 24 14:32:20 alice kernel: Bluetooth: RFCOMM socket layer initialized
Feb 24 14:32:20 alice kernel: Bluetooth: RFCOMM TTY layer initialized
Feb 24 14:32:20 alice kernel: Bluetooth: RFCOMM ver 1.8
Feb 24 14:32:20 alice pcscd: hotplug_libusb.c:402:HPEstablishUSBNotifications() Driver ifd-egate.bundle does not support IFD_GENERATE_HOTPLUG. Using active polling instead.
Feb 24 14:32:20 alice pcscd: hotplug_libusb.c:411:HPEstablishUSBNotifications() Polling forced every 1 second(s)
Feb 24 14:32:20 bob kernel: IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
Feb 24 14:32:20 bob kernel: TCP established hash table entries: 16384 (order: 5, 131072 bytes)
Feb 24 14:32:20 bob kernel: TCP bind hash table entries: 8192 (order: 4, 65536 bytes)
Feb 24 14:32:20 bob kernel: TCP: Hash tables configured (established 16384 bind 8192)
Feb 24 14:32:20 bob kernel: TCP reno registered
Feb 24 14:32:20 bob kernel: apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
Feb 24 14:32:20 bob kernel: apm: overridden by ACPI.
Feb 24 14:32:20 bob kernel: audit: initializing netlink socket (disabled)
Feb 24 14:32:20 bob kernel: type=2000 audit(1267018274.732:1): initialized
Feb 24 14:32:20 bob kernel: Total HugeTLB memory allocated, 0
Feb 24 14:32:20 bob kernel: VFS: Disk quotas dquot_6.5.1
Feb 24 14:32:20 bob kernel: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Feb 24 14:32:20 bob kernel: Initializing Cryptographic API
Feb 24 14:32:20 bob kernel: alg: No test for crc32c (crc32c-generic)
Feb 24 14:32:20 bob kernel: ksign: Installing public key data
Feb 24 14:32:20 bob kernel: Loading keyring
Feb 24 14:32:20 bob kernel: - Added public key 77280CF9B461AFBC
Feb 24 14:32:20 bob kernel: - User ID: CentOS (Kernel Module GPG key)
Feb 24 14:32:20 bob kernel: io scheduler noop registered
Feb 24 14:32:20 bob kernel: io scheduler anticipatory registered
Feb 24 14:32:20 bob kernel: io scheduler deadline registered
Feb 24 14:32:20 bob kernel: io scheduler cfq registered (default)
Feb 24 14:32:20 bob kernel: Limiting direct PCI/PCI transfers.
Feb 24 14:32:20 bob kernel: PCI: PIIX3: Enabling Passive Release on 0000:00:01.0
Feb 24 14:32:20 bob kernel: Activating ISA DMA hang workarounds.
Feb 24 14:32:20 bob kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Feb 24 14:32:20 bob kernel: Real Time Clock Driver v1.12ac
Feb 24 14:32:20 bob kernel: Non-volatile memory driver v1.2
Feb 24 14:32:20 bob kernel: Linux agpgart interface v0.101 (c) Dave Jones
Feb 24 14:32:20 bob kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Feb 24 14:32:20 bob kernel: brd: module loaded
Feb 24 14:32:21 bob kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Feb 24 14:32:21 bob kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Feb 24 14:32:21 bob kernel: PIIX3: IDE controller at PCI slot 0000:00:01.1
Feb 24 14:32:21 bob kernel: PIIX3: chipset revision 0
Feb 24 14:32:21 bob kernel: PIIX3: not 100% native mode: will probe irqs later
Feb 24 14:32:21 bob kernel:     ide0: BM-DMA at 0xc000-0xc007, BIOS settings: hda:pio, hdb:pio
Feb 24 14:32:21 bob kernel:     ide1: BM-DMA at 0xc008-0xc00f, BIOS settings: hdc:pio, hdd:pio
Feb 24 14:32:21 bob hcid[1867]: Bluetooth HCI daemon
Feb 24 14:32:21 bob kernel: hdc: QEMU DVD-ROM, ATAPI CD/DVD-ROM drive
Feb 24 14:32:21 bob hcid[1867]: Register path:/org/bluez fallback:1
Feb 24 14:32:21 bob kernel: ide1 at 0x170-0x177,0x376 on irq 15
Feb 24 14:32:21 bob sdpd[1871]: Bluetooth SDP daemon 
Feb 24 14:32:22 alice kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
Feb 24 14:32:22 alice hidd[2009]: Bluetooth HID daemon
Feb 24 14:32:22 alice logd: [2018]: info: logd started with default configuration.
Feb 24 14:32:22 alice logd: [2029]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 24 14:32:22 alice logd: [2018]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 24 14:32:22 bob kernel: ide-floppy driver 0.99.newide
Feb 24 14:32:22 bob kernel: usbcore: registered new driver hiddev
Feb 24 14:32:22 bob kernel: usbcore: registered new driver usbhid
Feb 24 14:32:22 bob kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver
Feb 24 14:32:22 bob kernel: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
Feb 24 14:32:22 bob kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Feb 24 14:32:22 bob kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Feb 24 14:32:22 bob kernel: mice: PS/2 mouse device common for all mice
Feb 24 14:32:22 bob kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Feb 24 14:32:22 bob kernel: md: bitmap version 4.39
Feb 24 14:32:22 bob kernel: TCP bic registered
Feb 24 14:32:22 bob kernel: Initializing IPsec netlink socket
Feb 24 14:32:22 bob kernel: NET: Registered protocol family 1
Feb 24 14:32:22 bob kernel: NET: Registered protocol family 17
Feb 24 14:32:22 bob kernel: Using IPI No-Shortcut mode
Feb 24 14:32:22 bob kernel: Time: kvm-clock clocksource has been installed.
Feb 24 14:32:22 bob kernel: ACPI: (supports S3 S4 S5)
Feb 24 14:32:22 bob kernel: Initalizing network drop monitor service
Feb 24 14:32:22 bob kernel: Freeing unused kernel memory: 228k freed
Feb 24 14:32:22 bob kernel: Write protecting the kernel read-only data: 405k
Feb 24 14:32:22 bob kernel: input: AT Translated Set 2 keyboard as /class/input/input0
Feb 24 14:32:22 bob kernel: input: ImExPS/2 Generic Explorer Mouse as /class/input/input1
Feb 24 14:32:22 bob kernel: USB Universal Host Controller Interface driver v3.0
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt 0000:00:01.2[D] -> Link [LNKD] -> GSI 11 (level, high) -> IRQ 11
Feb 24 14:32:22 bob kernel: uhci_hcd 0000:00:01.2: UHCI Host Controller
Feb 24 14:32:22 bob kernel: uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
Feb 24 14:32:22 bob kernel: uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020
Feb 24 14:32:22 bob kernel: usb usb1: configuration #1 chosen from 1 choice
Feb 24 14:32:22 bob kernel: hub 1-0:1.0: USB hub found
Feb 24 14:32:22 bob kernel: hub 1-0:1.0: 2 ports detected
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt 0000:00:03.0[A] -> Link [LNKC] -> GSI 10 (level, high) -> IRQ 10
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt 0000:00:04.0[A] -> Link [LNKD] -> GSI 11 (level, high) -> IRQ 11
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt 0000:00:05.0[A] -> Link [LNKA] -> GSI 10 (level, high) -> IRQ 10
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 11
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt 0000:00:06.0[A] -> Link [LNKB] -> GSI 11 (level, high) -> IRQ 11
Feb 24 14:32:22 bob kernel: ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [LNKC] -> GSI 10 (level, high) -> IRQ 10
Feb 24 14:32:22 bob kernel:  vda: vda1 vda2
Feb 24 14:32:22 bob kernel:  vdb: vdb1 vdb2 vdb3
Feb 24 14:32:22 bob kernel: SCSI subsystem initialized
Feb 24 14:32:22 bob kernel: device-mapper: uevent: version 1.0.3
Feb 24 14:32:22 bob kernel: device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@redhat.com
Feb 24 14:32:22 bob kernel: device-mapper: dm-raid45: initialized v0.2594l
Feb 24 14:32:22 bob kernel: EXT3-fs: INFO: recovery required on readonly filesystem.
Feb 24 14:32:22 bob kernel: EXT3-fs: write access will be enabled during recovery.
Feb 24 14:32:22 bob kernel: kjournald starting.  Commit interval 5 seconds
Feb 24 14:32:22 bob kernel: EXT3-fs: vda1: orphan cleanup on readonly fs
Feb 24 14:32:22 bob pcscd: pcscdaemon.c:507:main() pcsc-lite 1.4.4 daemon ready.
Feb 24 14:32:22 bob kernel: EXT3-fs: vda1: 4 orphan inodes deleted
Feb 24 14:32:23 alice automount[2042]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
Feb 24 14:32:23 bob kernel: EXT3-fs: recovery complete.
Feb 24 14:32:23 bob kernel: EXT3-fs: mounted filesystem with ordered data mode.
Feb 24 14:32:23 bob kernel: SELinux:  Disabled at runtime.
Feb 24 14:32:23 bob kernel: type=1404 audit(1267018305.032:2): selinux=0 auid=4294967295 ses=4294967295
Feb 24 14:32:23 bob kernel: hdc: ATAPI 4X CD-ROM drive, 512kB Cache, (U)DMA
Feb 24 14:32:23 bob kernel: Uniform CD-ROM driver Revision: 3.20
Feb 24 14:32:23 bob kernel: input: PC Speaker as /class/input/input2
Feb 24 14:32:23 bob kernel: piix4_smbus 0000:00:01.3: Found 0000:00:01.3 device
Feb 24 14:32:23 bob kernel: FDC 0 is a S82078B
Feb 24 14:32:23 bob kernel: lp: driver loaded but no devices found
Feb 24 14:32:23 bob kernel: ACPI: Power Button (FF) [PWRF]
Feb 24 14:32:23 bob kernel: md: Autodetecting RAID arrays.
Feb 24 14:32:23 bob kernel: md: autorun ...
Feb 24 14:32:23 bob kernel: md: ... autorun DONE.
Feb 24 14:32:23 bob kernel: device-mapper: multipath: version 1.0.5 loaded
Feb 24 14:32:23 bob kernel: EXT3 FS on vda1, internal journal
Feb 24 14:32:23 bob kernel: Adding 522104k swap on /dev/vda2.  Priority:-1 extents:1 across:522104k
Feb 24 14:32:23 bob kernel: IA-32 Microcode Update Driver: v1.14a <tigran@veritas.com>
Feb 24 14:32:23 bob kernel: microcode: CPU0 updated from revision 0x0 to 0x0, date = 09231998 
Feb 24 14:32:23 bob kernel: NET: Registered protocol family 10
Feb 24 14:32:23 bob kernel: lo: Disabled Privacy Extensions
Feb 24 14:32:23 bob kernel: IPv6 over IPv4 tunneling driver
Feb 24 14:32:23 bob kernel: process `sysctl' is using deprecated sysctl (syscall) net.ipv6.neigh.lo.base_reachable_time; Use net.ipv6.neigh.lo.base_reachable_time_ms instead.
Feb 24 14:32:23 bob kernel: Bluetooth: Core ver 2.10
Feb 24 14:32:23 bob kernel: NET: Registered protocol family 31
Feb 24 14:32:23 bob kernel: Bluetooth: HCI device and connection manager initialized
Feb 24 14:32:23 bob kernel: Bluetooth: HCI socket layer initialized
Feb 24 14:32:23 bob kernel: Bluetooth: L2CAP ver 2.8
Feb 24 14:32:23 bob kernel: Bluetooth: L2CAP socket layer initialized
Feb 24 14:32:23 bob kernel: Bluetooth: RFCOMM socket layer initialized
Feb 24 14:32:23 bob kernel: Bluetooth: RFCOMM TTY layer initialized
Feb 24 14:32:23 bob kernel: Bluetooth: RFCOMM ver 1.8
Feb 24 14:32:23 bob pcscd: hotplug_libusb.c:402:HPEstablishUSBNotifications() Driver ifd-egate.bundle does not support IFD_GENERATE_HOTPLUG. Using active polling instead.
Feb 24 14:32:23 bob pcscd: hotplug_libusb.c:411:HPEstablishUSBNotifications() Polling forced every 1 second(s)
Feb 24 14:32:24 bob kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
Feb 24 14:32:24 bob hidd[2009]: Bluetooth HID daemon
Feb 24 14:32:25 alice heartbeat: [2118]: info: No log entry found in ha.cf -- use logd
Feb 24 14:32:25 alice heartbeat: [2118]: info: Enabling logging daemon 
Feb 24 14:32:25 alice heartbeat: [2118]: info: logfile and debug file are those specified in logd config file (default /etc/logd.cf)
Feb 24 14:32:25 alice heartbeat: [2118]: info: **************************
Feb 24 14:32:25 alice heartbeat: [2118]: info: Configuration validated. Starting heartbeat 3.0.2
Feb 24 14:32:25 alice heartbeat: [2119]: info: heartbeat: version 3.0.2
Feb 24 14:32:26 bob automount[2036]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
Feb 24 14:32:27 alice gpm[2163]: *** info [startup.c(95)]: 
Feb 24 14:32:27 alice gpm[2163]: Started gpm successfully. Entered daemon mode.
Feb 24 14:32:29 alice heartbeat: [2119]: info: Heartbeat generation: 1265995379
Feb 24 14:32:29 alice heartbeat: [2119]: info: glib: UDP multicast heartbeat started for group 239.0.0.43 port 694 interface eth0 (ttl=1 loop=0)
Feb 24 14:32:29 alice heartbeat: [2119]: info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1
Feb 24 14:32:29 alice heartbeat: [2119]: info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1
Feb 24 14:32:29 alice heartbeat: [2119]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 24 14:32:29 alice heartbeat: [2119]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 24 14:32:29 alice heartbeat: [2119]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:29 alice heartbeat: [2119]: info: Stack hogger failed 0xffffffff
Feb 24 14:32:29 alice heartbeat: [2119]: info: Local status now set to: 'up'
Feb 24 14:32:30 alice heartbeat: [2207]: info: Stack hogger failed 0xffffffff
Feb 24 14:32:30 alice heartbeat: [2208]: info: Stack hogger failed 0xffffffff
Feb 24 14:32:30 alice heartbeat: [2209]: info: Stack hogger failed 0xffffffff
Feb 24 14:32:30 alice heartbeat: [2210]: info: Stack hogger failed 0xffffffff
Feb 24 14:32:30 alice heartbeat: [2211]: info: Stack hogger failed 0xffffffff
Feb 24 14:32:30 alice heartbeat: [2119]: info: Link alice.demo:eth1 up.
Feb 24 14:32:31 alice avahi-daemon[2234]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70).
Feb 24 14:32:31 alice avahi-daemon[2234]: Successfully dropped root privileges.
Feb 24 14:32:31 alice avahi-daemon[2234]: avahi-daemon 0.6.16 starting up.
Feb 24 14:32:31 alice avahi-daemon[2234]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
Feb 24 14:32:31 alice avahi-daemon[2234]: Successfully called chroot().
Feb 24 14:32:31 alice avahi-daemon[2234]: Successfully dropped remaining capabilities.
Feb 24 14:32:31 alice avahi-daemon[2234]: Loading service file /services/sftp-ssh.service.
Feb 24 14:32:31 alice avahi-daemon[2234]: New relevant interface eth1.IPv6 for mDNS.
Feb 24 14:32:31 alice avahi-daemon[2234]: Joining mDNS multicast group on interface eth1.IPv6 with address fe80::5054:ff:fe2c:8a93.
Feb 24 14:32:31 alice avahi-daemon[2234]: New relevant interface eth1.IPv4 for mDNS.
Feb 24 14:32:31 alice avahi-daemon[2234]: Joining mDNS multicast group on interface eth1.IPv4 with address 192.168.133.111.
Feb 24 14:32:31 alice avahi-daemon[2234]: New relevant interface eth0.IPv6 for mDNS.
Feb 24 14:32:31 alice avahi-daemon[2234]: Joining mDNS multicast group on interface eth0.IPv6 with address fe80::5054:ff:fe8d:9c39.
Feb 24 14:32:31 alice avahi-daemon[2234]: New relevant interface eth0.IPv4 for mDNS.
Feb 24 14:32:31 alice avahi-daemon[2234]: Joining mDNS multicast group on interface eth0.IPv4 with address 192.168.122.111.
Feb 24 14:32:31 alice avahi-daemon[2234]: Network interface enumeration completed.
Feb 24 14:32:31 alice avahi-daemon[2234]: Registering new address record for fe80::5054:ff:fe2c:8a93 on eth1.
Feb 24 14:32:31 alice avahi-daemon[2234]: Registering new address record for 192.168.133.111 on eth1.
Feb 24 14:32:31 alice avahi-daemon[2234]: Registering new address record for fe80::5054:ff:fe8d:9c39 on eth0.
Feb 24 14:32:31 alice avahi-daemon[2234]: Registering new address record for 192.168.122.111 on eth0.
Feb 24 14:32:31 alice avahi-daemon[2234]: Registering HINFO record with values 'I686'/'LINUX'.
Feb 24 14:32:31 bob gpm[2164]: *** info [startup.c(95)]: 
Feb 24 14:32:31 bob gpm[2164]: Started gpm successfully. Entered daemon mode.
Feb 24 14:32:32 alice heartbeat: [2119]: info: Link bob.demo:eth0 up.
Feb 24 14:32:32 alice heartbeat: [2119]: info: Link bob.demo:eth1 up.
Feb 24 14:32:32 alice heartbeat: [2119]: info: Status update for node bob.demo: status up
Feb 24 14:32:32 alice heartbeat: [2119]: info: Comm_now_up(): updating status to active
Feb 24 14:32:32 alice heartbeat: [2119]: info: Local status now set to: 'active'
Feb 24 14:32:32 alice heartbeat: [2119]: info: Starting child client "/usr/lib/heartbeat/ccm" (101,103)
Feb 24 14:32:32 alice heartbeat: [2119]: info: Starting child client "/usr/lib/heartbeat/cib" (101,103)
Feb 24 14:32:32 alice avahi-daemon[2234]: Server startup complete. Host name is alice.local. Local service cookie is 2001238919.
Feb 24 14:32:32 alice heartbeat: [2119]: info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0)
Feb 24 14:32:33 alice heartbeat: [2119]: info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0)
Feb 24 14:32:33 alice heartbeat: [2119]: info: Starting child client "/usr/lib/heartbeat/attrd" (101,103)
Feb 24 14:32:33 alice heartbeat: [2119]: info: Starting child client "/usr/lib/heartbeat/crmd" (101,103)
Feb 24 14:32:33 alice heartbeat: [2263]: info: Starting "/usr/lib/heartbeat/ccm" as uid 101  gid 103 (pid 2263)
Feb 24 14:32:33 alice heartbeat: [2264]: info: Starting "/usr/lib/heartbeat/cib" as uid 101  gid 103 (pid 2264)
Feb 24 14:32:33 alice heartbeat: [2265]: info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0  gid 0 (pid 2265)
Feb 24 14:32:33 alice heartbeat: [2266]: info: Starting "/usr/lib/heartbeat/stonithd" as uid 0  gid 0 (pid 2266)
Feb 24 14:32:33 alice heartbeat: [2267]: info: Starting "/usr/lib/heartbeat/attrd" as uid 101  gid 103 (pid 2267)
Feb 24 14:32:33 alice heartbeat: [2268]: info: Starting "/usr/lib/heartbeat/crmd" as uid 101  gid 103 (pid 2268)
Feb 24 14:32:33 bob ccm: [2214]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:32:33 bob ccm: [2214]: info: Hostname: bob.demo
Feb 24 14:32:34 alice avahi-daemon[2234]: Service "SFTP File Transfer on alice" (/services/sftp-ssh.service) successfully established.
Feb 24 14:32:34 alice heartbeat: [2119]: info: Status update for node bob.demo: status active
Feb 24 14:32:34 alice lrmd: [2265]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 24 14:32:34 alice smartd[2262]: smartd version 5.38 [i686-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen 
Feb 24 14:32:34 alice smartd[2262]: Home page is http://smartmontools.sourceforge.net/  
Feb 24 14:32:34 alice smartd[2262]: Opened configuration file /etc/smartd.conf 
Feb 24 14:32:34 alice smartd[2262]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices 
Feb 24 14:32:34 alice ccm: [2263]: info: Hostname: alice.demo
Feb 24 14:32:34 alice smartd[2262]: Problem creating device name scan list 
Feb 24 14:32:34 alice smartd[2262]: Device: /dev/hdc, opened 
Feb 24 14:32:34 alice smartd[2262]: Device: /dev/hdc, not ATA, no IDENTIFY DEVICE Structure 
Feb 24 14:32:34 alice smartd[2262]: Monitoring 0 ATA and 0 SCSI devices 
Feb 24 14:32:34 alice kernel: hdc: drive_cmd: status=0x41 { DriveReady Error }
Feb 24 14:32:34 alice kernel: hdc: drive_cmd: error=0x04 { AbortedCommand }
Feb 24 14:32:34 alice kernel: ide: failed opcode was: 0xec
Feb 24 14:32:34 alice smartd[2272]: smartd has fork()ed into background mode. New PID=2272. 
Feb 24 14:32:34 alice stonithd: [2266]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 24 14:32:34 bob lrmd: [2216]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:32:34 bob lrmd: [2216]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 24 14:32:34 bob attrd: [2218]: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Feb 24 14:32:34 bob attrd: [2218]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:32:34 bob attrd: [2218]: info: Invoked: /usr/lib/heartbeat/attrd 
Feb 24 14:32:34 bob attrd: [2218]: info: main: Starting up
Feb 24 14:32:34 bob attrd: [2218]: info: crm_cluster_connect: Connecting to Heartbeat
Feb 24 14:32:34 bob attrd: [2218]: info: register_heartbeat_conn: Hostname: bob.demo
Feb 24 14:32:34 bob attrd: [2218]: info: register_heartbeat_conn: UUID: 0af1add7-22b5-4342-9816-67e6351605de
Feb 24 14:32:34 bob attrd: [2218]: info: main: Cluster connection active
Feb 24 14:32:34 bob attrd: [2218]: info: main: Accepting attribute updates
Feb 24 14:32:34 bob attrd: [2218]: info: main: Starting mainloop...
Feb 24 14:32:34 bob cib: [2215]: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Feb 24 14:32:34 bob cib: [2215]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:32:34 bob cib: [2215]: info: Invoked: /usr/lib/heartbeat/cib 
Feb 24 14:32:34 bob cib: [2215]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 24 14:32:34 bob cib: [2215]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:34 bob stonithd: [2217]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:32:34 bob lrmd: [2216]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:34 bob lrmd: [2216]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 24 14:32:34 bob lrmd: [2216]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 24 14:32:34 bob cib: [2215]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 24 14:32:34 bob crmd: [2219]: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Feb 24 14:32:35 alice cib: [2264]: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Feb 24 14:32:35 alice attrd: [2267]: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Feb 24 14:32:35 alice stonithd: [2266]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 24 14:32:35 alice crmd: [2268]: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Feb 24 14:32:35 alice stonithd: [2266]: info: Stack hogger failed 0xffffffff
Feb 24 14:32:35 alice lrmd: [2265]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:35 alice lrmd: [2265]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 24 14:32:35 alice lrmd: [2265]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 24 14:32:35 alice lrmd: [2265]: info: Started.
Feb 24 14:32:35 alice cib: [2264]: info: Invoked: /usr/lib/heartbeat/cib 
Feb 24 14:32:35 alice cib: [2264]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 24 14:32:35 alice cib: [2264]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:35 alice attrd: [2267]: info: Invoked: /usr/lib/heartbeat/attrd 
Feb 24 14:32:35 alice attrd: [2267]: info: main: Starting up
Feb 24 14:32:35 alice attrd: [2267]: info: crm_cluster_connect: Connecting to Heartbeat
Feb 24 14:32:35 bob crmd: [2219]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:32:35 bob crmd: [2219]: info: Invoked: /usr/lib/heartbeat/crmd 
Feb 24 14:32:34 bob lrmd: [2216]: info: Started.
Feb 24 14:32:35 bob crmd: [2219]: info: main: CRM Hg Version: 54d7869bfe3691eb723b1d47810e5585d8246b58 
Feb 24 14:32:34 bob avahi-daemon[2237]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70).
Feb 24 14:32:34 bob stonithd: [2217]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 24 14:32:35 bob avahi-daemon[2237]: Successfully dropped root privileges.
Feb 24 14:32:35 bob crmd: [2219]: info: crmd_init: Starting crmd
Feb 24 14:32:35 bob stonithd: [2217]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 24 14:32:35 bob avahi-daemon[2237]: avahi-daemon 0.6.16 starting up.
Feb 24 14:32:35 bob crmd: [2219]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:35 bob stonithd: [2217]: info: Stack hogger failed 0xffffffff
Feb 24 14:32:35 bob avahi-daemon[2237]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
Feb 24 14:32:35 bob avahi-daemon[2237]: Successfully called chroot().
Feb 24 14:32:35 bob cib: [2215]: info: startCib: CIB Initialization completed successfully
Feb 24 14:32:35 bob avahi-daemon[2237]: Successfully dropped remaining capabilities.
Feb 24 14:32:36 alice cib: [2264]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 24 14:32:36 alice crmd: [2268]: info: Invoked: /usr/lib/heartbeat/crmd 
Feb 24 14:32:36 alice crmd: [2268]: info: main: CRM Hg Version: 54d7869bfe3691eb723b1d47810e5585d8246b58 
Feb 24 14:32:36 alice crmd: [2268]: info: crmd_init: Starting crmd
Feb 24 14:32:36 alice crmd: [2268]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:36 alice stonithd: [2266]: info: crm_cluster_connect: Connecting to Heartbeat
Feb 24 14:32:36 alice attrd: [2267]: info: register_heartbeat_conn: Hostname: alice.demo
Feb 24 14:32:36 alice attrd: [2267]: info: register_heartbeat_conn: UUID: df0d4306-9cf3-4c5c-a23a-027ac36da131
Feb 24 14:32:36 alice attrd: [2267]: info: main: Cluster connection active
Feb 24 14:32:36 alice attrd: [2267]: info: main: Accepting attribute updates
Feb 24 14:32:36 alice attrd: [2267]: info: main: Starting mainloop...
Feb 24 14:32:36 alice stonithd: [2266]: info: register_heartbeat_conn: Hostname: alice.demo
Feb 24 14:32:36 alice stonithd: [2266]: info: register_heartbeat_conn: UUID: df0d4306-9cf3-4c5c-a23a-027ac36da131
Feb 24 14:32:36 alice stonithd: [2266]: notice: /usr/lib/heartbeat/stonithd start up successfully.
Feb 24 14:32:36 alice stonithd: [2266]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:36 alice cib: [2264]: info: startCib: CIB Initialization completed successfully
Feb 24 14:32:36 alice cib: [2264]: info: crm_cluster_connect: Connecting to Heartbeat
Feb 24 14:32:36 alice cib: [2264]: info: register_heartbeat_conn: Hostname: alice.demo
Feb 24 14:32:36 alice cib: [2264]: info: register_heartbeat_conn: UUID: df0d4306-9cf3-4c5c-a23a-027ac36da131
Feb 24 14:32:36 alice cib: [2264]: info: ccm_connect: Registering with CCM...
Feb 24 14:32:36 alice cib: [2264]: WARN: ccm_connect: CCM Activation failed
Feb 24 14:32:36 alice cib: [2264]: WARN: ccm_connect: CCM Connection failed 1 times (30 max)
Feb 24 14:32:36 alice crmd: [2268]: info: do_cib_control: Could not connect to the CIB service: connection failed
Feb 24 14:32:36 alice crmd: [2268]: WARN: do_cib_control: Couldn't complete CIB registration 1 times... pause and retry
Feb 24 14:32:36 alice crmd: [2268]: info: crmd_init: Starting crmd's mainloop
Feb 24 14:32:36 bob stonithd: [2217]: info: crm_cluster_connect: Connecting to Heartbeat
Feb 24 14:32:36 bob cib: [2215]: info: crm_cluster_connect: Connecting to Heartbeat
Feb 24 14:32:36 bob avahi-daemon[2237]: Loading service file /services/sftp-ssh.service.
Feb 24 14:32:36 bob stonithd: [2217]: info: register_heartbeat_conn: Hostname: bob.demo
Feb 24 14:32:36 bob stonithd: [2217]: info: register_heartbeat_conn: UUID: 0af1add7-22b5-4342-9816-67e6351605de
Feb 24 14:32:36 bob avahi-daemon[2237]: New relevant interface eth1.IPv6 for mDNS.
Feb 24 14:32:36 bob avahi-daemon[2237]: Joining mDNS multicast group on interface eth1.IPv6 with address fe80::5054:ff:fe74:dd9.
Feb 24 14:32:36 bob avahi-daemon[2237]: New relevant interface eth1.IPv4 for mDNS.
Feb 24 14:32:36 bob avahi-daemon[2237]: Joining mDNS multicast group on interface eth1.IPv4 with address 192.168.133.112.
Feb 24 14:32:36 bob avahi-daemon[2237]: New relevant interface eth0.IPv6 for mDNS.
Feb 24 14:32:36 bob stonithd: [2217]: notice: /usr/lib/heartbeat/stonithd start up successfully.
Feb 24 14:32:36 bob cib: [2215]: info: register_heartbeat_conn: Hostname: bob.demo
Feb 24 14:32:36 bob avahi-daemon[2237]: Joining mDNS multicast group on interface eth0.IPv6 with address fe80::5054:ff:fe12:8793.
Feb 24 14:32:36 bob stonithd: [2217]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 24 14:32:36 bob cib: [2215]: info: register_heartbeat_conn: UUID: 0af1add7-22b5-4342-9816-67e6351605de
Feb 24 14:32:36 bob avahi-daemon[2237]: New relevant interface eth0.IPv4 for mDNS.
Feb 24 14:32:36 bob cib: [2215]: info: ccm_connect: Registering with CCM...
Feb 24 14:32:36 bob avahi-daemon[2237]: Joining mDNS multicast group on interface eth0.IPv4 with address 192.168.122.112.
Feb 24 14:32:36 bob ccm: [2214]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 24 14:32:36 bob cib: [2215]: WARN: ccm_connect: CCM Activation failed
Feb 24 14:32:36 bob avahi-daemon[2237]: Network interface enumeration completed.
Feb 24 14:32:36 bob crmd: [2219]: info: do_cib_control: Could not connect to the CIB service: connection failed
Feb 24 14:32:36 bob cib: [2215]: WARN: ccm_connect: CCM Connection failed 1 times (30 max)
Feb 24 14:32:36 bob avahi-daemon[2237]: Registering new address record for fe80::5054:ff:fe74:dd9 on eth1.
Feb 24 14:32:36 bob crmd: [2219]: WARN: do_cib_control: Couldn't complete CIB registration 1 times... pause and retry
Feb 24 14:32:36 bob avahi-daemon[2237]: Registering new address record for 192.168.133.112 on eth1.
Feb 24 14:32:36 bob crmd: [2219]: info: crmd_init: Starting crmd's mainloop
Feb 24 14:32:36 bob avahi-daemon[2237]: Registering new address record for fe80::5054:ff:fe12:8793 on eth0.
Feb 24 14:32:36 bob avahi-daemon[2237]: Registering new address record for 192.168.122.112 on eth0.
Feb 24 14:32:36 bob avahi-daemon[2237]: Registering HINFO record with values 'I686'/'LINUX'.
Feb 24 14:32:37 alice ccm: [2263]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 24 14:32:38 alice crmd: [2268]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Feb 24 14:32:38 bob avahi-daemon[2237]: Server startup complete. Host name is bob.local. Local service cookie is 2629426536.
Feb 24 14:32:38 bob crmd: [2219]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Feb 24 14:32:39 alice cib: [2264]: info: ccm_connect: Registering with CCM...
Feb 24 14:32:39 alice cib: [2264]: info: cib_init: Requesting the list of configured nodes
Feb 24 14:32:39 alice crmd: [2268]: info: do_cib_control: Could not connect to the CIB service: connection failed
Feb 24 14:32:39 alice crmd: [2268]: WARN: do_cib_control: Couldn't complete CIB registration 2 times... pause and retry
Feb 24 14:32:39 alice cib: [2264]: info: cib_init: Starting cib mainloop
Feb 24 14:32:39 alice cib: [2264]: info: cib_client_status_callback: Status update: Client alice.demo/cib now has status [join]
Feb 24 14:32:39 alice cib: [2264]: info: crm_new_peer: Node 0 is now known as alice.demo
Feb 24 14:32:39 alice cib: [2264]: info: crm_update_peer_proc: alice.demo.cib is now online
Feb 24 14:32:39 alice cib: [2264]: info: cib_client_status_callback: Status update: Client bob.demo/cib now has status [join]
Feb 24 14:32:39 alice cib: [2264]: info: crm_new_peer: Node 0 is now known as bob.demo
Feb 24 14:32:39 alice cib: [2264]: info: crm_update_peer_proc: bob.demo.cib is now online
Feb 24 14:32:39 alice cib: [2264]: info: cib_client_status_callback: Status update: Client alice.demo/cib now has status [online]
Feb 24 14:32:39 alice cib: [2332]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-92.raw
Feb 24 14:32:39 bob avahi-daemon[2237]: Service "SFTP File Transfer on bob" (/services/sftp-ssh.service) successfully established.
Feb 24 14:32:39 bob smartd[2264]: smartd version 5.38 [i686-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen 
Feb 24 14:32:39 bob smartd[2264]: Home page is http://smartmontools.sourceforge.net/  
Feb 24 14:32:39 bob smartd[2264]: Opened configuration file /etc/smartd.conf 
Feb 24 14:32:39 bob smartd[2264]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices 
Feb 24 14:32:39 bob smartd[2264]: Problem creating device name scan list 
Feb 24 14:32:39 bob smartd[2264]: Device: /dev/hdc, opened 
Feb 24 14:32:39 bob kernel: hdc: drive_cmd: status=0x41 { DriveReady Error }
Feb 24 14:32:39 bob kernel: hdc: drive_cmd: error=0x04 { AbortedCommand }
Feb 24 14:32:39 bob kernel: ide: failed opcode was: 0xec
Feb 24 14:32:39 bob smartd[2264]: Device: /dev/hdc, not ATA, no IDENTIFY DEVICE Structure 
Feb 24 14:32:39 bob smartd[2264]: Monitoring 0 ATA and 0 SCSI devices 
Feb 24 14:32:39 bob cib: [2215]: info: ccm_connect: Registering with CCM...
Feb 24 14:32:39 bob cib: [2215]: info: cib_init: Requesting the list of configured nodes
Feb 24 14:32:39 bob smartd[2266]: smartd has fork()ed into background mode. New PID=2266. 
Feb 24 14:32:39 bob crmd: [2219]: info: do_cib_control: Could not connect to the CIB service: connection failed
Feb 24 14:32:39 bob crmd: [2219]: WARN: do_cib_control: Couldn't complete CIB registration 2 times... pause and retry
Feb 24 14:32:40 alice cib: [2332]: info: write_cib_contents: Wrote version 0.87.0 of the CIB to disk (digest: 56c2495b7e317270c2b0e79164825dc9)
Feb 24 14:32:40 alice cib: [2332]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.WC4Dof (digest: /var/lib/heartbeat/crm/cib.Uhzpxd)
Feb 24 14:32:40 alice cib: [2264]: info: cib_client_status_callback: Status update: Client bob.demo/cib now has status [online]
Feb 24 14:32:40 alice attrd: [2267]: info: cib_connect: Connected to the CIB after 1 signon attempts
Feb 24 14:32:40 alice attrd: [2267]: info: cib_connect: Sending full refresh
Feb 24 14:32:40 alice heartbeat: [2119]: WARN: 1 lost packet(s) for [bob.demo] [18:20]
Feb 24 14:32:40 alice heartbeat: [2119]: info: No pkts missing from bob.demo!
Feb 24 14:32:40 bob cib: [2215]: info: cib_init: Starting cib mainloop
Feb 24 14:32:40 bob cib: [2215]: info: cib_client_status_callback: Status update: Client bob.demo/cib now has status [join]
Feb 24 14:32:40 bob cib: [2215]: info: crm_new_peer: Node 0 is now known as bob.demo
Feb 24 14:32:40 bob cib: [2215]: info: crm_update_peer_proc: bob.demo.cib is now online
Feb 24 14:32:40 bob ccm: [2214]: info: Break tie for 2 nodes cluster
Feb 24 14:32:40 bob cib: [2215]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 24 14:32:40 bob cib: [2215]: info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3
Feb 24 14:32:40 bob cib: [2215]: info: cib_ccm_msg_callback: Processing CCM event=NEW MEMBERSHIP (id=1)
Feb 24 14:32:40 bob cib: [2215]: info: crm_get_peer: Node bob.demo now has id: 1
Feb 24 14:32:40 bob cib: [2215]: info: crm_update_peer: Node bob.demo: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=1 proc=00000000000000000000000000000100
Feb 24 14:32:40 bob cib: [2215]: info: crm_update_peer_proc: bob.demo.ais is now online
Feb 24 14:32:40 bob cib: [2215]: info: crm_update_peer_proc: bob.demo.crmd is now online
Feb 24 14:32:40 bob cib: [2275]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-95.raw
Feb 24 14:32:40 bob cib: [2215]: info: cib_client_status_callback: Status update: Client bob.demo/cib now has status [online]
Feb 24 14:32:40 bob cib: [2275]: info: write_cib_contents: Wrote version 0.87.0 of the CIB to disk (digest: cc20196bc399e593a1cee67b529a2aac)
Feb 24 14:32:40 bob cib: [2275]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.6ZmcBI (digest: /var/lib/heartbeat/crm/cib.HcItRB)
Feb 24 14:32:41 alice crmd: [2268]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Feb 24 14:32:41 alice cib: [2264]: WARN: G_CH_check_int: working on Heartbeat API channel took 220 ms (> 100 ms)
Feb 24 14:32:41 alice crmd: [2268]: info: do_cib_control: CIB connection established
Feb 24 14:32:41 alice crmd: [2268]: info: crm_cluster_connect: Connecting to Heartbeat
Feb 24 14:32:41 alice cib: [2264]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 24 14:32:41 alice crmd: [2268]: info: register_heartbeat_conn: Hostname: alice.demo
Feb 24 14:32:41 alice cib: [2264]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 24 14:32:41 alice crmd: [2268]: info: register_heartbeat_conn: UUID: df0d4306-9cf3-4c5c-a23a-027ac36da131
Feb 24 14:32:41 alice cib: [2264]: info: cib_ccm_msg_callback: Processing CCM event=NEW MEMBERSHIP (id=2)
Feb 24 14:32:41 alice cib: [2264]: info: crm_get_peer: Node bob.demo now has id: 1
Feb 24 14:32:41 alice cib: [2264]: info: crm_update_peer: Node bob.demo: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000100
Feb 24 14:32:41 alice cib: [2264]: info: crm_update_peer_proc: bob.demo.ais is now online
Feb 24 14:32:41 alice cib: [2264]: info: crm_update_peer_proc: bob.demo.crmd is now online
Feb 24 14:32:41 alice cib: [2264]: info: crm_update_peer: Node alice.demo: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000100
Feb 24 14:32:41 alice cib: [2264]: info: crm_update_peer_proc: alice.demo.ais is now online
Feb 24 14:32:41 alice cib: [2264]: info: crm_update_peer_proc: alice.demo.crmd is now online
Feb 24 14:32:41 bob cib: [2215]: info: cib_client_status_callback: Status update: Client alice.demo/cib now has status [online]
Feb 24 14:32:41 bob cib: [2215]: info: crm_new_peer: Node 0 is now known as alice.demo
Feb 24 14:32:41 bob cib: [2215]: info: crm_update_peer_proc: alice.demo.cib is now online
Feb 24 14:32:41 bob cib: [2215]: info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm
Feb 24 14:32:41 bob cib: [2215]: info: mem_handle_event: no mbr_track info
Feb 24 14:32:41 bob cib: [2215]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 24 14:32:41 bob cib: [2215]: info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4
Feb 24 14:32:41 bob cib: [2215]: info: cib_ccm_msg_callback: Processing CCM event=NEW MEMBERSHIP (id=2)
Feb 24 14:32:41 bob cib: [2215]: info: crm_update_peer: Node alice.demo: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000100
Feb 24 14:32:41 bob cib: [2215]: info: crm_update_peer_proc: alice.demo.ais is now online
Feb 24 14:32:41 bob cib: [2215]: info: crm_update_peer_proc: alice.demo.crmd is now online
Feb 24 14:32:41 bob crmd: [2219]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Feb 24 14:32:41 bob crmd: [2219]: info: do_cib_control: CIB connection established
Feb 24 14:32:41 bob crmd: [2219]: info: crm_cluster_connect: Connecting to Heartbeat
Feb 24 14:32:42 alice crmd: [2268]: info: do_ha_control: Connected to the cluster
Feb 24 14:32:42 alice crmd: [2268]: info: do_ccm_control: CCM connection established... waiting for first callback
Feb 24 14:32:42 alice crmd: [2268]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Feb 24 14:32:42 alice crmd: [2268]: notice: crmd_client_status_callback: Status update: Client alice.demo/crmd now has status [online] (DC=false)
Feb 24 14:32:42 alice crmd: [2268]: info: crm_new_peer: Node 0 is now known as alice.demo
Feb 24 14:32:42 alice crmd: [2268]: info: crm_update_peer_proc: alice.demo.crmd is now online
Feb 24 14:32:42 alice crmd: [2268]: info: crmd_client_status_callback: Not the DC
Feb 24 14:32:42 alice crmd: [2268]: notice: crmd_client_status_callback: Status update: Client bob.demo/crmd now has status [online] (DC=false)
Feb 24 14:32:42 bob crmd: [2219]: info: register_heartbeat_conn: Hostname: bob.demo
Feb 24 14:32:42 bob crmd: [2219]: info: register_heartbeat_conn: UUID: 0af1add7-22b5-4342-9816-67e6351605de
Feb 24 14:32:42 bob crmd: [2219]: info: do_ha_control: Connected to the cluster
Feb 24 14:32:42 bob crmd: [2219]: info: do_ccm_control: CCM connection established... waiting for first callback
Feb 24 14:32:42 bob crmd: [2219]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Feb 24 14:32:42 bob crmd: [2219]: info: config_query_callback: Checking for expired actions every 900000ms
Feb 24 14:32:42 bob crmd: [2219]: notice: crmd_client_status_callback: Status update: Client bob.demo/crmd now has status [online] (DC=false)
Feb 24 14:32:43 alice heartbeat: [2119]: WARN: 1 lost packet(s) for [bob.demo] [24:26]
Feb 24 14:32:43 alice crmd: [2268]: info: crm_new_peer: Node 0 is now known as bob.demo
Feb 24 14:32:43 alice heartbeat: [2119]: info: No pkts missing from bob.demo!
Feb 24 14:32:43 alice crmd: [2268]: info: crm_update_peer_proc: bob.demo.crmd is now online
Feb 24 14:32:43 alice crmd: [2268]: info: crmd_client_status_callback: Not the DC
Feb 24 14:32:43 alice crmd: [2268]: notice: crmd_client_status_callback: Status update: Client alice.demo/crmd now has status [online] (DC=false)
Feb 24 14:32:43 alice crmd: [2268]: info: crmd_client_status_callback: Not the DC
Feb 24 14:32:43 alice crmd: [2268]: notice: crmd_client_status_callback: Status update: Client bob.demo/crmd now has status [online] (DC=false)
Feb 24 14:32:43 alice crmd: [2268]: info: crmd_client_status_callback: Not the DC
Feb 24 14:32:43 alice crmd: [2268]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Feb 24 14:32:43 alice crmd: [2268]: info: config_query_callback: Checking for expired actions every 900000ms
Feb 24 14:32:43 alice crmd: [2268]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 24 14:32:43 alice crmd: [2268]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 24 14:32:43 alice crmd: [2268]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
Feb 24 14:32:43 alice crmd: [2268]: info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Feb 24 14:32:43 alice crmd: [2268]: info: ccm_event_detail: 	CURRENT: bob.demo [nodeid=1, born=1]
Feb 24 14:32:43 alice crmd: [2268]: info: ccm_event_detail: 	CURRENT: alice.demo [nodeid=0, born=2]
Feb 24 14:32:43 alice crmd: [2268]: info: ccm_event_detail: 	NEW:     bob.demo [nodeid=1, born=1]
Feb 24 14:32:43 alice crmd: [2268]: info: ccm_event_detail: 	NEW:     alice.demo [nodeid=0, born=2]
Feb 24 14:32:43 alice crmd: [2268]: info: crm_get_peer: Node bob.demo now has id: 1
Feb 24 14:32:43 alice crmd: [2268]: info: crm_update_peer: Node bob.demo: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000200
Feb 24 14:32:43 alice crmd: [2268]: info: crm_update_peer_proc: bob.demo.ais is now online
Feb 24 14:32:43 alice crmd: [2268]: info: crm_update_peer: Node alice.demo: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000200
Feb 24 14:32:43 alice crmd: [2268]: info: crm_update_peer_proc: alice.demo.ais is now online
Feb 24 14:32:43 bob crmd: [2219]: info: crm_new_peer: Node 0 is now known as bob.demo
Feb 24 14:32:43 bob crmd: [2219]: info: crm_update_peer_proc: bob.demo.crmd is now online
Feb 24 14:32:43 bob crmd: [2219]: info: crmd_client_status_callback: Not the DC
Feb 24 14:32:43 bob crmd: [2219]: notice: crmd_client_status_callback: Status update: Client bob.demo/crmd now has status [online] (DC=false)
Feb 24 14:32:43 bob crmd: [2219]: info: crmd_client_status_callback: Not the DC
Feb 24 14:32:43 bob crmd: [2219]: notice: crmd_client_status_callback: Status update: Client alice.demo/crmd now has status [online] (DC=false)
Feb 24 14:32:43 bob crmd: [2219]: info: crm_new_peer: Node 0 is now known as alice.demo
Feb 24 14:32:43 bob crmd: [2219]: info: crm_update_peer_proc: alice.demo.crmd is now online
Feb 24 14:32:43 bob crmd: [2219]: info: crmd_client_status_callback: Not the DC
Feb 24 14:32:43 bob crmd: [2219]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 24 14:32:43 bob crmd: [2219]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 24 14:32:43 bob crmd: [2219]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
Feb 24 14:32:43 bob crmd: [2219]: info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Feb 24 14:32:43 bob crmd: [2219]: info: ccm_event_detail: 	CURRENT: bob.demo [nodeid=1, born=1]
Feb 24 14:32:43 bob crmd: [2219]: info: ccm_event_detail: 	CURRENT: alice.demo [nodeid=0, born=2]
Feb 24 14:32:43 bob crmd: [2219]: info: ccm_event_detail: 	NEW:     bob.demo [nodeid=1, born=1]
Feb 24 14:32:43 bob crmd: [2219]: info: ccm_event_detail: 	NEW:     alice.demo [nodeid=0, born=2]
Feb 24 14:32:43 bob crmd: [2219]: info: crm_get_peer: Node bob.demo now has id: 1
Feb 24 14:32:43 bob crmd: [2219]: info: crm_update_peer: Node bob.demo: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000200
Feb 24 14:32:43 bob crmd: [2219]: info: crm_update_peer_proc: bob.demo.ais is now online
Feb 24 14:32:43 bob crmd: [2219]: info: crm_update_peer: Node alice.demo: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000200
Feb 24 14:32:44 alice crmd: [2268]: info: do_started: The local CRM is operational
Feb 24 14:32:44 alice crmd: [2268]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Feb 24 14:32:44 bob crmd: [2219]: info: crm_update_peer_proc: alice.demo.ais is now online
Feb 24 14:32:44 bob crmd: [2219]: info: do_started: The local CRM is operational
Feb 24 14:32:44 bob crmd: [2219]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Feb 24 14:32:44 bob attrd: [2218]: info: cib_connect: Connected to the CIB after 2 signon attempts
Feb 24 14:32:44 bob attrd: [2218]: info: cib_connect: Sending full refresh
Feb 24 14:33:44 alice crmd: [2268]: info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped!
Feb 24 14:33:44 alice crmd: [2268]: WARN: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING
Feb 24 14:33:44 alice crmd: [2268]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
Feb 24 14:33:45 alice crmd: [2268]: info: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Feb 24 14:33:45 alice crmd: [2268]: info: do_dc_release: DC role released
Feb 24 14:33:45 alice crmd: [2268]: info: do_te_control: Transitioner is now inactive
Feb 24 14:33:45 bob crmd: [2219]: info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped!
Feb 24 14:33:45 bob crmd: [2219]: WARN: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING
Feb 24 14:33:45 bob crmd: [2219]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
Feb 24 14:33:45 bob crmd: [2219]: info: do_election_count_vote: Election 2 (owner: df0d4306-9cf3-4c5c-a23a-027ac36da131) pass: vote from alice.demo (Age)
Feb 24 14:33:46 bob crmd: [2219]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
Feb 24 14:33:46 bob crmd: [2219]: info: do_te_control: Registering TE UUID: e72e2598-a6a9-4509-b4c6-0a6c558e1e02
Feb 24 14:33:46 bob crmd: [2219]: WARN: cib_client_add_notify_callback: Callback already present
Feb 24 14:33:46 bob crmd: [2219]: info: set_graph_functions: Setting custom graph functions
Feb 24 14:33:46 bob crmd: [2219]: info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses
Feb 24 14:33:46 bob crmd: [2219]: info: start_subsystem: Starting sub-system "pengine"
Feb 24 14:33:46 bob pengine: [2329]: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Feb 24 14:33:46 bob pengine: [2329]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:33:46 bob pengine: [2329]: info: Invoked: /usr/lib/heartbeat/pengine 
Feb 24 14:33:46 bob pengine: [2329]: info: main: Starting pengine
Feb 24 14:33:49 bob crmd: [2219]: info: do_dc_takeover: Taking over DC status for this partition
Feb 24 14:33:49 bob cib: [2215]: info: cib_process_readwrite: We are now in R/W mode
Feb 24 14:33:49 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/6, version=0.87.0): ok (rc=0)
Feb 24 14:33:49 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/7, version=0.87.0): ok (rc=0)
Feb 24 14:33:49 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/9, version=0.87.0): ok (rc=0)
Feb 24 14:33:49 bob crmd: [2219]: info: join_make_offer: Making join offers based on membership 2
Feb 24 14:33:49 bob crmd: [2219]: info: do_dc_join_offer_all: join-1: Waiting on 2 outstanding join acks
Feb 24 14:33:49 bob crmd: [2219]: info: te_connect_stonith: Attempting connection to fencing daemon...
Feb 24 14:33:49 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/11, version=0.87.0): ok (rc=0)
Feb 24 14:33:50 alice crmd: [2268]: info: update_dc: Set DC to bob.demo (3.0.1)
Feb 24 14:33:50 bob crmd: [2219]: info: te_connect_stonith: Connected
Feb 24 14:33:50 bob crmd: [2219]: info: config_query_callback: Checking for expired actions every 900000ms
Feb 24 14:33:50 bob crmd: [2219]: info: update_dc: Set DC to bob.demo (3.0.1)
Feb 24 14:33:51 alice crmd: [2268]: info: update_attrd: Connecting to attrd...
Feb 24 14:33:51 alice crmd: [2268]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Feb 24 14:33:51 alice attrd: [2267]: info: find_hash_entry: Creating hash entry for terminate
Feb 24 14:33:51 alice attrd: [2267]: info: find_hash_entry: Creating hash entry for shutdown
Feb 24 14:33:51 alice attrd: [2267]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Feb 24 14:33:51 alice attrd: [2267]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
Feb 24 14:33:51 alice attrd: [2267]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
Feb 24 14:33:51 bob crmd: [2219]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Feb 24 14:33:51 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes responded to the join offer.
Feb 24 14:33:51 bob crmd: [2219]: info: do_dc_join_finalize: join-1: Syncing the CIB from bob.demo to the rest of the cluster
Feb 24 14:33:51 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/14, version=0.87.0): ok (rc=0)
Feb 24 14:33:51 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/15, version=0.87.0): ok (rc=0)
Feb 24 14:33:51 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/16, version=0.87.0): ok (rc=0)
Feb 24 14:33:51 bob crmd: [2219]: info: update_attrd: Connecting to attrd...
Feb 24 14:33:51 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='bob.demo']/transient_attributes (origin=local/crmd/17, version=0.87.0): ok (rc=0)
Feb 24 14:33:51 bob crmd: [2219]: info: erase_xpath_callback: Deletion of "//node_state[@uname='bob.demo']/transient_attributes": ok (rc=0)
Feb 24 14:33:51 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='bob.demo']/lrm (origin=local/crmd/18, version=0.87.0): ok (rc=0)
Feb 24 14:33:51 bob crmd: [2219]: info: erase_xpath_callback: Deletion of "//node_state[@uname='bob.demo']/lrm": ok (rc=0)
Feb 24 14:33:51 bob attrd: [2218]: info: find_hash_entry: Creating hash entry for terminate
Feb 24 14:33:51 bob attrd: [2218]: info: find_hash_entry: Creating hash entry for shutdown
Feb 24 14:33:51 bob crmd: [2219]: info: do_dc_join_ack: join-1: Updating node state to member for bob.demo
Feb 24 14:33:51 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='bob.demo']/lrm (origin=local/crmd/19, version=0.87.0): ok (rc=0)
Feb 24 14:33:51 bob crmd: [2219]: info: erase_xpath_callback: Deletion of "//node_state[@uname='bob.demo']/lrm": ok (rc=0)
Feb 24 14:33:52 alice attrd: [2267]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:33:52 alice attrd: [2267]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:33:52 alice crmd: [2268]: info: erase_xpath_callback: Deletion of "//node_state[@uname='alice.demo']/transient_attributes": ok (rc=0)
Feb 24 14:33:52 alice crmd: [2268]: info: erase_xpath_callback: Deletion of "//node_state[@uname='alice.demo']/lrm": ok (rc=0)
Feb 24 14:33:52 bob crmd: [2219]: info: do_dc_join_ack: join-1: Updating node state to member for alice.demo
Feb 24 14:33:52 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='alice.demo']/transient_attributes (origin=alice.demo/crmd/9, version=0.87.1): ok (rc=0)
Feb 24 14:33:52 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='alice.demo']/lrm (origin=alice.demo/crmd/10, version=0.87.1): ok (rc=0)
Feb 24 14:33:52 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='alice.demo']/lrm (origin=local/crmd/21, version=0.87.1): ok (rc=0)
Feb 24 14:33:52 bob crmd: [2219]: info: erase_xpath_callback: Deletion of "//node_state[@uname='alice.demo']/lrm": ok (rc=0)
Feb 24 14:33:52 bob crmd: [2219]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
Feb 24 14:33:52 bob crmd: [2219]: info: populate_cib_nodes_ha: Requesting the list of configured nodes
Feb 24 14:33:52 bob attrd: [2218]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:33:52 bob attrd: [2218]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:33:53 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:33:53 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:33:53 alice cib: [2338]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-93.raw
Feb 24 14:33:53 alice cib: [2338]: info: write_cib_contents: Wrote version 0.88.0 of the CIB to disk (digest: 558f383a94c2541d049bb4df79e6bba6)
Feb 24 14:33:53 alice cib: [2338]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.7kx848 (digest: /var/lib/heartbeat/crm/cib.jOKvW8)
Feb 24 14:33:53 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 24 14:33:53 bob crmd: [2219]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
Feb 24 14:33:53 bob crmd: [2219]: info: crm_update_quorum: Updating quorum status to true (call=25)
Feb 24 14:33:53 bob crmd: [2219]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
Feb 24 14:33:53 bob crmd: [2219]: info: do_pe_invoke: Query 26: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:33:53 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/23, version=0.87.2): ok (rc=0)
Feb 24 14:33:53 bob cib: [2215]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="87" num_updates="2" />
Feb 24 14:33:53 bob cib: [2215]: info: log_data_element: cib:diff: + <cib dc-uuid="0af1add7-22b5-4342-9816-67e6351605de" admin_epoch="0" epoch="88" num_updates="1" />
Feb 24 14:33:53 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/25, version=0.88.1): ok (rc=0)
Feb 24 14:33:53 bob crmd: [2219]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
Feb 24 14:33:53 bob crmd: [2219]: info: need_abort: Aborting on change to admin_epoch
Feb 24 14:33:53 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=26, ref=pe_calc-dc-1267018433-10, seq=2, quorate=1
Feb 24 14:33:53 bob crmd: [2219]: info: do_pe_invoke: Query 27: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:33:53 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=27, ref=pe_calc-dc-1267018433-11, seq=2, quorate=1
Feb 24 14:33:53 bob attrd: [2218]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Feb 24 14:33:53 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
Feb 24 14:33:53 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:33:53 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:33:53 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:33:53 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:33:53 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:33:53 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:33:53 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:33:53 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:33:53 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
Feb 24 14:33:53 bob cib: [2330]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-96.raw
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:33:53 bob cib: [2330]: info: write_cib_contents: Wrote version 0.88.0 of the CIB to disk (digest: 20aa6d7b705101ca03f69070be160e79)
Feb 24 14:33:53 bob cib: [2330]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.XP3WOW (digest: /var/lib/heartbeat/crm/cib.13Cj3P)
Feb 24 14:33:53 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:33:53 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql1:0 res_drbd_mysql1:1 ]
Feb 24 14:33:53 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:33:53 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql2:0 res_drbd_mysql2:1 ]
Feb 24 14:33:53 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:33:53 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:33:53 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:33:53 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:33:53 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:53 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:33:53 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:33:53 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:33:53 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:33:53 bob attrd: [2218]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:33:53 bob attrd: [2218]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:33:53 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_fs_mysql1 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_ip_mysql1: Rolling back scores from res_mysql1
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_ip_mysql1 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_mysql1 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_fs_mysql2 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_ip_mysql2: Rolling back scores from res_mysql2
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_ip_mysql2 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_mysql2 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql1	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql1	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql1	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql1:0	(alice.demo)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql1:1	(bob.demo)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql2:0	(alice.demo)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql2:1	(bob.demo)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql2	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql2	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql2	(Stopped)
Feb 24 14:33:54 bob crmd: [2219]: info: handle_response: pe_calc calculation pe_calc-dc-1267018433-10 is obsolete
Feb 24 14:33:54 bob pengine: [2329]: WARN: process_pe_message: Transition 0: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-91.bz2
Feb 24 14:33:54 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:33:54 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:33:54 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:33:54 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:33:54 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:33:54 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:33:54 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:33:54 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:33:54 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql1:0 res_drbd_mysql1:1 ]
Feb 24 14:33:54 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:33:54 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql2:0 res_drbd_mysql2:1 ]
Feb 24 14:33:54 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql2
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_fs_mysql1 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_ip_mysql1: Rolling back scores from res_mysql1
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_ip_mysql1 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_mysql1 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_fs_mysql2 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: info: native_merge_weights: res_ip_mysql2: Rolling back scores from res_mysql2
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_ip_mysql2 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: WARN: native_color: Resource res_mysql2 cannot run anywhere
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql1	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql1	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql1	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql1:0	(alice.demo)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql1:1	(bob.demo)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql2:0	(alice.demo)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql2:1	(bob.demo)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql2	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql2	(Stopped)
Feb 24 14:33:54 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql2	(Stopped)
Feb 24 14:33:54 bob crmd: [2219]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb 24 14:33:54 bob crmd: [2219]: info: unpack_graph: Unpacked transition 1: 49 actions in 49 synapses
Feb 24 14:33:54 bob pengine: [2329]: WARN: process_pe_message: Transition 1: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-92.bz2
Feb 24 14:33:54 bob crmd: [2219]: info: do_te_invoke: Processing graph 1 (ref=pe_calc-dc-1267018433-11) derived from /var/lib/pengine/pe-warn-92.bz2
Feb 24 14:33:54 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:33:54 bob crmd: [2219]: info: te_rsc_command: Initiating action 4: monitor res_drbd_nfsexport:0_monitor_0 on alice.demo
Feb 24 14:33:54 bob crmd: [2219]: info: te_rsc_command: Initiating action 17: monitor res_drbd_nfsexport:0_monitor_0 on bob.demo (local)
Feb 24 14:33:54 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=17:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_nfsexport:0_monitor_0 )
Feb 24 14:33:55 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=4:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_nfsexport:0_monitor_0 )
Feb 24 14:33:55 alice lrmd: [2265]: info: rsc:res_drbd_nfsexport:0:2: monitor
Feb 24 14:33:55 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=5:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_nfsexport_monitor_0 )
Feb 24 14:33:55 alice lrmd: [2265]: info: rsc:res_fs_nfsexport:3: monitor
Feb 24 14:33:55 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=6:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_nfs_monitor_0 )
Feb 24 14:33:55 alice lrmd: [2265]: info: rsc:res_ip_nfs:4: monitor
Feb 24 14:33:55 alice lrmd: [2265]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Feb 24 14:33:55 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=7:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_nfs_monitor_0 )
Feb 24 14:33:55 alice lrmd: [2265]: info: rsc:res_nfs:5: monitor
Feb 24 14:33:55 bob lrmd: [2216]: info: rsc:res_drbd_nfsexport:0:2: monitor
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 5: monitor res_fs_nfsexport_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 18: monitor res_fs_nfsexport_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=18:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_nfsexport_monitor_0 )
Feb 24 14:33:55 bob lrmd: [2216]: info: rsc:res_fs_nfsexport:3: monitor
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 6: monitor res_ip_nfs_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 19: monitor res_ip_nfs_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=19:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_nfs_monitor_0 )
Feb 24 14:33:55 bob lrmd: [2216]: info: rsc:res_ip_nfs:4: monitor
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 7: monitor res_nfs_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 20: monitor res_nfs_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob lrmd: [2216]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=20:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_nfs_monitor_0 )
Feb 24 14:33:55 bob lrmd: [2216]: info: rsc:res_nfs:5: monitor
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 8: monitor res_fs_mysql1_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 21: monitor res_fs_mysql1_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=21:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_mysql1_monitor_0 )
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 9: monitor res_ip_mysql1_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 22: monitor res_ip_mysql1_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=22:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_mysql1_monitor_0 )
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 10: monitor res_mysql1_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 23: monitor res_mysql1_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=23:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_mysql1_monitor_0 )
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 11: monitor res_drbd_mysql1:0_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 24: monitor res_drbd_mysql1:1_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=24:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:1_monitor_0 )
Feb 24 14:33:55 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 65 fired and confirmed
Feb 24 14:33:55 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 66 fired and confirmed
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 12: monitor res_drbd_mysql2:0_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 25: monitor res_drbd_mysql2:1_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=25:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:1_monitor_0 )
Feb 24 14:33:55 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 91 fired and confirmed
Feb 24 14:33:55 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 92 fired and confirmed
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 13: monitor res_fs_mysql2_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 26: monitor res_fs_mysql2_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=26:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_mysql2_monitor_0 )
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 14: monitor res_ip_mysql2_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 27: monitor res_ip_mysql2_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=27:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_mysql2_monitor_0 )
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 15: monitor res_mysql2_monitor_0 on alice.demo
Feb 24 14:33:55 bob crmd: [2219]: info: te_rsc_command: Initiating action 28: monitor res_mysql2_monitor_0 on bob.demo (local)
Feb 24 14:33:55 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=28:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_mysql2_monitor_0 )
Feb 24 14:33:55 bob lrmd: [2216]: info: RA output: (res_fs_nfsexport:monitor:stderr) logd is not running
Feb 24 14:33:55 bob lrmd: [2216]: info: RA output: (res_fs_nfsexport:monitor:stderr) 2010/02/24_14:33:55 WARNING: Couldn't find device [/dev/drbd/by-res/nfsexport]. Expected /dev/??? to exist 
Feb 24 14:33:56 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=8:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_mysql1_monitor_0 )
Feb 24 14:33:56 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=9:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_mysql1_monitor_0 )
Feb 24 14:33:56 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=10:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_mysql1_monitor_0 )
Feb 24 14:33:56 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=11:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_monitor_0 )
Feb 24 14:33:56 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=12:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:0_monitor_0 )
Feb 24 14:33:56 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=13:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_mysql2_monitor_0 )
Feb 24 14:33:56 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=14:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_mysql2_monitor_0 )
Feb 24 14:33:56 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=15:1:7:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_mysql2_monitor_0 )
Feb 24 14:33:56 alice Filesystem[2340]: [2369]: WARNING: Couldn't find device [/dev/drbd/by-res/nfsexport]. Expected /dev/??? to exist
Feb 24 14:33:56 bob crmd: [2219]: info: process_lrm_event: LRM operation res_ip_nfs_monitor_0 (call=4, rc=7, cib-update=28, confirmed=true) not running
Feb 24 14:33:56 bob crmd: [2219]: info: match_graph_event: Action res_ip_nfs_monitor_0 (19) confirmed on bob.demo (rc=0)
Feb 24 14:33:56 bob lrmd: [2216]: info: rsc:res_mysql1:8: monitor
Feb 24 14:33:56 bob crmd: [2219]: info: process_lrm_event: LRM operation res_mysql1_monitor_0 (call=8, rc=7, cib-update=29, confirmed=true) not running
Feb 24 14:33:56 bob crmd: [2219]: info: match_graph_event: Action res_mysql1_monitor_0 (23) confirmed on bob.demo (rc=0)
Feb 24 14:33:56 bob lrmd: [2216]: info: rsc:res_fs_mysql2:11: monitor
Feb 24 14:33:56 bob lrmd: [2216]: info: RA output: (res_fs_mysql2:monitor:stderr) logd is not running
Feb 24 14:33:56 bob lrmd: [2216]: info: RA output: (res_fs_mysql2:monitor:stderr) 2010/02/24_14:33:56 WARNING: Couldn't find device [/dev/drbd/by-res/mysql2]. Expected /dev/??? to exist 
Feb 24 14:33:56 bob crmd: [2219]: info: process_lrm_event: LRM operation res_nfs_monitor_0 (call=5, rc=7, cib-update=30, confirmed=true) not running
Feb 24 14:33:56 bob crmd: [2219]: info: match_graph_event: Action res_nfs_monitor_0 (20) confirmed on bob.demo (rc=0)
Feb 24 14:33:56 bob crmd: [2219]: info: process_lrm_event: LRM operation res_fs_nfsexport_monitor_0 (call=3, rc=7, cib-update=31, confirmed=true) not running
Feb 24 14:33:56 bob crmd: [2219]: info: match_graph_event: Action res_fs_nfsexport_monitor_0 (18) confirmed on bob.demo (rc=0)
Feb 24 14:33:57 alice crmd: [2268]: info: process_lrm_event: LRM operation res_ip_nfs_monitor_0 (call=4, rc=7, cib-update=11, confirmed=true) not running
Feb 24 14:33:57 alice crmd: [2268]: info: process_lrm_event: LRM operation res_nfs_monitor_0 (call=5, rc=7, cib-update=12, confirmed=true) not running
Feb 24 14:33:57 alice crmd: [2268]: info: process_lrm_event: LRM operation res_fs_nfsexport_monitor_0 (call=3, rc=7, cib-update=13, confirmed=true) not running
Feb 24 14:33:57 alice crm_attribute: [2453]: info: Invoked: crm_attribute -N alice.demo -n master-res_drbd_nfsexport:0 -l reboot -D 
Feb 24 14:33:57 alice attrd: [2267]: info: find_hash_entry: Creating hash entry for master-res_drbd_nfsexport:0
Feb 24 14:33:57 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_nfsexport:0_monitor_0 (call=2, rc=7, cib-update=14, confirmed=true) not running
Feb 24 14:33:57 bob crmd: [2219]: info: process_lrm_event: LRM operation res_fs_mysql2_monitor_0 (call=11, rc=7, cib-update=32, confirmed=true) not running
Feb 24 14:33:57 bob crmd: [2219]: info: match_graph_event: Action res_fs_mysql2_monitor_0 (26) confirmed on bob.demo (rc=0)
Feb 24 14:33:57 bob crm_attribute: [2499]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:33:57 bob crm_attribute: [2499]: info: Invoked: crm_attribute -N bob.demo -n master-res_drbd_nfsexport:0 -l reboot -D 
Feb 24 14:33:57 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_nfsexport:0_monitor_0 (call=2, rc=7, cib-update=33, confirmed=true) not running
Feb 24 14:33:57 bob attrd: [2218]: info: find_hash_entry: Creating hash entry for master-res_drbd_nfsexport:0
Feb 24 14:33:57 bob crmd: [2219]: info: match_graph_event: Action res_drbd_nfsexport:0_monitor_0 (17) confirmed on bob.demo (rc=0)
Feb 24 14:33:57 bob lrmd: [2216]: info: rsc:res_fs_mysql1:6: monitor
Feb 24 14:33:57 bob lrmd: [2216]: info: rsc:res_ip_mysql1:7: monitor
Feb 24 14:33:57 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:1:9: monitor
Feb 24 14:33:57 bob lrmd: [2216]: info: rsc:res_drbd_mysql2:1:10: monitor
Feb 24 14:33:57 bob lrmd: [2216]: info: RA output: (res_fs_mysql1:monitor:stderr) logd is not running
Feb 24 14:33:58 alice lrmd: [2265]: info: rsc:res_fs_mysql1:6: monitor
Feb 24 14:33:58 alice lrmd: [2265]: info: rsc:res_ip_mysql1:7: monitor
Feb 24 14:33:58 alice lrmd: [2265]: info: rsc:res_mysql1:8: monitor
Feb 24 14:33:58 alice lrmd: [2265]: info: rsc:res_drbd_mysql1:0:9: monitor
Feb 24 14:33:58 alice Filesystem[2457]: [2465]: WARNING: Couldn't find device [/dev/drbd/by-res/mysql1]. Expected /dev/??? to exist
Feb 24 14:33:58 alice crmd: [2268]: info: process_lrm_event: LRM operation res_mysql1_monitor_0 (call=8, rc=7, cib-update=15, confirmed=true) not running
Feb 24 14:33:58 alice crm_attribute: [2535]: info: Invoked: crm_attribute -N alice.demo -n master-res_drbd_mysql1:0 -l reboot -D 
Feb 24 14:33:58 alice attrd: [2267]: info: find_hash_entry: Creating hash entry for master-res_drbd_mysql1:0
Feb 24 14:33:58 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_monitor_0 (call=9, rc=7, cib-update=16, confirmed=true) not running
Feb 24 14:33:58 alice crmd: [2268]: info: process_lrm_event: LRM operation res_fs_mysql1_monitor_0 (call=6, rc=7, cib-update=17, confirmed=true) not running
Feb 24 14:33:58 alice crmd: [2268]: info: process_lrm_event: LRM operation res_ip_mysql1_monitor_0 (call=7, rc=7, cib-update=18, confirmed=true) not running
Feb 24 14:33:58 bob lrmd: [2216]: info: RA output: (res_fs_mysql1:monitor:stderr) 2010/02/24_14:33:57 WARNING: Couldn't find device [/dev/drbd/by-res/mysql1]. Expected /dev/??? to exist 
Feb 24 14:33:58 bob crm_attribute: [2601]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:33:58 bob crm_attribute: [2601]: info: Invoked: crm_attribute -N bob.demo -n master-res_drbd_mysql1:1 -l reboot -D 
Feb 24 14:33:58 bob attrd: [2218]: info: find_hash_entry: Creating hash entry for master-res_drbd_mysql1:1
Feb 24 14:33:58 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:1_monitor_0 (call=9, rc=7, cib-update=34, confirmed=true) not running
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:1_monitor_0 (24) confirmed on bob.demo (rc=0)
Feb 24 14:33:58 bob crm_attribute: [2614]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:33:58 bob crm_attribute: [2614]: info: Invoked: crm_attribute -N bob.demo -n master-res_drbd_mysql2:1 -l reboot -D 
Feb 24 14:33:58 bob attrd: [2218]: info: find_hash_entry: Creating hash entry for master-res_drbd_mysql2:1
Feb 24 14:33:58 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql2:1_monitor_0 (call=10, rc=7, cib-update=35, confirmed=true) not running
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:1_monitor_0 (25) confirmed on bob.demo (rc=0)
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_ip_nfs_monitor_0 (6) confirmed on alice.demo (rc=0)
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_nfs_monitor_0 (7) confirmed on alice.demo (rc=0)
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_fs_nfsexport_monitor_0 (5) confirmed on alice.demo (rc=0)
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_drbd_nfsexport:0_monitor_0 (4) confirmed on alice.demo (rc=0)
Feb 24 14:33:58 bob crmd: [2219]: info: process_lrm_event: LRM operation res_ip_mysql1_monitor_0 (call=7, rc=7, cib-update=36, confirmed=true) not running
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_ip_mysql1_monitor_0 (22) confirmed on bob.demo (rc=0)
Feb 24 14:33:58 bob crmd: [2219]: info: process_lrm_event: LRM operation res_fs_mysql1_monitor_0 (call=6, rc=7, cib-update=37, confirmed=true) not running
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_fs_mysql1_monitor_0 (21) confirmed on bob.demo (rc=0)
Feb 24 14:33:58 bob lrmd: [2216]: info: rsc:res_ip_mysql2:12: monitor
Feb 24 14:33:58 bob lrmd: [2216]: info: rsc:res_mysql2:13: monitor
Feb 24 14:33:58 bob crmd: [2219]: info: process_lrm_event: LRM operation res_mysql2_monitor_0 (call=13, rc=7, cib-update=38, confirmed=true) not running
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_mysql2_monitor_0 (28) confirmed on bob.demo (rc=0)
Feb 24 14:33:58 bob crmd: [2219]: info: process_lrm_event: LRM operation res_ip_mysql2_monitor_0 (call=12, rc=7, cib-update=39, confirmed=true) not running
Feb 24 14:33:58 bob crmd: [2219]: info: match_graph_event: Action res_ip_mysql2_monitor_0 (27) confirmed on bob.demo (rc=0)
Feb 24 14:33:58 bob crmd: [2219]: info: te_rsc_command: Initiating action 16: probe_complete probe_complete on bob.demo (local) - no waiting
Feb 24 14:33:58 bob attrd: [2218]: info: find_hash_entry: Creating hash entry for probe_complete
Feb 24 14:33:58 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Feb 24 14:33:58 bob attrd: [2218]: info: attrd_perform_update: Sent update 10: probe_complete=true
Feb 24 14:33:58 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=0af1add7-22b5-4342-9816-67e6351605de, magic=NA, cib=0.88.18) : Transient attribute: update
Feb 24 14:33:58 bob crmd: [2219]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb 24 14:33:58 bob crmd: [2219]: info: update_abort_priority: Abort action done superceeded by restart
Feb 24 14:33:59 alice lrmd: [2265]: info: rsc:res_drbd_mysql2:0:10: monitor
Feb 24 14:33:59 alice lrmd: [2265]: info: rsc:res_fs_mysql2:11: monitor
Feb 24 14:33:59 alice lrmd: [2265]: info: rsc:res_ip_mysql2:12: monitor
Feb 24 14:33:59 alice lrmd: [2265]: info: rsc:res_mysql2:13: monitor
Feb 24 14:33:59 alice crmd: [2268]: info: process_lrm_event: LRM operation res_mysql2_monitor_0 (call=13, rc=7, cib-update=19, confirmed=true) not running
Feb 24 14:33:59 alice Filesystem[2568]: [2585]: WARNING: Couldn't find device [/dev/drbd/by-res/mysql2]. Expected /dev/??? to exist
Feb 24 14:33:59 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:33:59 alice attrd: [2267]: info: find_hash_entry: Creating hash entry for probe_complete
Feb 24 14:33:59 alice crmd: [2268]: info: process_lrm_event: LRM operation res_ip_mysql2_monitor_0 (call=12, rc=7, cib-update=20, confirmed=true) not running
Feb 24 14:33:59 alice crm_attribute: [2668]: info: Invoked: crm_attribute -N alice.demo -n master-res_drbd_mysql2:0 -l reboot -D 
Feb 24 14:33:59 alice attrd: [2267]: info: find_hash_entry: Creating hash entry for master-res_drbd_mysql2:0
Feb 24 14:33:59 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql2:0_monitor_0 (call=10, rc=7, cib-update=21, confirmed=true) not running
Feb 24 14:33:59 alice crmd: [2268]: info: process_lrm_event: LRM operation res_fs_mysql2_monitor_0 (call=11, rc=7, cib-update=22, confirmed=true) not running
Feb 24 14:33:59 bob crmd: [2219]: info: match_graph_event: Action res_mysql1_monitor_0 (10) confirmed on alice.demo (rc=0)
Feb 24 14:33:59 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_monitor_0 (11) confirmed on alice.demo (rc=0)
Feb 24 14:33:59 bob crmd: [2219]: info: match_graph_event: Action res_fs_mysql1_monitor_0 (8) confirmed on alice.demo (rc=0)
Feb 24 14:33:59 bob crmd: [2219]: info: match_graph_event: Action res_ip_mysql1_monitor_0 (9) confirmed on alice.demo (rc=0)
Feb 24 14:33:59 bob crmd: [2219]: info: match_graph_event: Action res_mysql2_monitor_0 (15) confirmed on alice.demo (rc=0)
Feb 24 14:34:00 alice attrd: [2267]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Feb 24 14:34:00 alice attrd: [2267]: info: attrd_perform_update: Sent update 11: probe_complete=true
Feb 24 14:34:00 bob crmd: [2219]: info: match_graph_event: Action res_ip_mysql2_monitor_0 (14) confirmed on alice.demo (rc=0)
Feb 24 14:34:00 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:0_monitor_0 (12) confirmed on alice.demo (rc=0)
Feb 24 14:34:00 bob crmd: [2219]: info: match_graph_event: Action res_fs_mysql2_monitor_0 (13) confirmed on alice.demo (rc=0)
Feb 24 14:34:00 bob crmd: [2219]: info: te_rsc_command: Initiating action 3: probe_complete probe_complete on alice.demo - no waiting
Feb 24 14:34:00 bob crmd: [2219]: info: run_graph: ====================================================
Feb 24 14:34:00 bob crmd: [2219]: notice: run_graph: Transition 1 (Complete=30, Pending=0, Fired=0, Skipped=9, Incomplete=10, Source=/var/lib/pengine/pe-warn-92.bz2): Stopped
Feb 24 14:34:00 bob crmd: [2219]: info: te_graph_trigger: Transition 1 is now complete
Feb 24 14:34:00 bob crmd: [2219]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb 24 14:34:00 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 24 14:34:00 bob crmd: [2219]: info: do_pe_invoke: Query 40: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:34:00 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=40, ref=pe_calc-dc-1267018440-38, seq=2, quorate=1
Feb 24 14:34:00 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:34:00 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:34:00 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:34:00 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:34:00 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:34:00 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:34:00 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:34:00 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql1:0 res_drbd_mysql1:1 ]
Feb 24 14:34:00 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:34:00 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql2:0 res_drbd_mysql2:1 ]
Feb 24 14:34:00 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:00 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:00 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:00 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:00 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql2
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql2
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:00 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_fs_mysql1 cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_ip_mysql1: Rolling back scores from res_mysql1
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_ip_mysql1 cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_mysql1 cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:00 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:00 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_fs_mysql2 cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: info: native_merge_weights: res_ip_mysql2: Rolling back scores from res_mysql2
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_ip_mysql2 cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: WARN: native_color: Resource res_mysql2 cannot run anywhere
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql1	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql1	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql1	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql1:0	(alice.demo)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql1:1	(bob.demo)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql2:0	(alice.demo)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql2:1	(bob.demo)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql2	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql2	(Stopped)
Feb 24 14:34:00 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql2	(Stopped)
Feb 24 14:34:00 bob crmd: [2219]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb 24 14:34:00 bob crmd: [2219]: info: unpack_graph: Unpacked transition 2: 21 actions in 21 synapses
Feb 24 14:34:00 bob pengine: [2329]: WARN: process_pe_message: Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-93.bz2
Feb 24 14:34:00 bob crmd: [2219]: info: do_te_invoke: Processing graph 2 (ref=pe_calc-dc-1267018440-38) derived from /var/lib/pengine/pe-warn-93.bz2
Feb 24 14:34:00 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:34:00 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 41 fired and confirmed
Feb 24 14:34:00 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 42 fired and confirmed
Feb 24 14:34:00 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 67 fired and confirmed
Feb 24 14:34:00 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 68 fired and confirmed
Feb 24 14:34:00 bob crmd: [2219]: info: te_rsc_command: Initiating action 3: probe_complete probe_complete on alice.demo - no waiting
Feb 24 14:34:00 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 39 fired and confirmed
Feb 24 14:34:00 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 65 fired and confirmed
Feb 24 14:34:00 bob crmd: [2219]: info: te_rsc_command: Initiating action 37: start res_drbd_mysql1:0_start_0 on alice.demo
Feb 24 14:34:00 bob crmd: [2219]: info: te_rsc_command: Initiating action 38: start res_drbd_mysql1:1_start_0 on bob.demo (local)
Feb 24 14:34:00 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=38:2:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:1_start_0 )
Feb 24 14:34:00 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:1:14: start
Feb 24 14:34:00 bob crmd: [2219]: info: te_rsc_command: Initiating action 63: start res_drbd_mysql2:0_start_0 on alice.demo
Feb 24 14:34:00 bob crmd: [2219]: info: te_rsc_command: Initiating action 64: start res_drbd_mysql2:1_start_0 on bob.demo (local)
Feb 24 14:34:00 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=64:2:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:1_start_0 )
Feb 24 14:34:00 bob lrmd: [2216]: info: rsc:res_drbd_mysql2:1:15: start
Feb 24 14:34:01 alice attrd: [2267]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Feb 24 14:34:01 alice lrmd: [2265]: info: rsc:res_drbd_mysql1:0:14: start
Feb 24 14:34:01 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=37:2:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_start_0 )
Feb 24 14:34:01 alice attrd: [2267]: info: attrd_perform_update: Sent update 14: probe_complete=true
Feb 24 14:34:01 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=63:2:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:0_start_0 )
Feb 24 14:34:01 alice lrmd: [2265]: info: rsc:res_drbd_mysql2:0:15: start
Feb 24 14:34:01 bob kernel: drbd: initialized. Version: 8.3.7 (api:88/proto:86-91)
Feb 24 14:34:01 bob kernel: drbd: GIT-hash: ea9e28dbff98e331a62bcbcc63a6135808fe2917 build by buildsystem@linbit, 2010-01-25 11:41:08
Feb 24 14:34:01 bob kernel: drbd: registered as block device major 147
Feb 24 14:34:01 bob kernel: drbd: minor_table @ 0xd5a0e8e0
Feb 24 14:34:01 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:1:start:stdout)  
Feb 24 14:34:01 bob kernel: block drbd1: Starting worker thread (from cqueue/0 [92])
Feb 24 14:34:01 bob kernel: block drbd1: disk( Diskless -> Attaching ) 
Feb 24 14:34:01 bob lrmd: [2216]: info: RA output: (res_drbd_mysql2:1:start:stdout)  
Feb 24 14:34:01 bob kernel: block drbd1: Found 4 transactions (4 active extents) in activity log.
Feb 24 14:34:01 bob kernel: block drbd1: Method to ensure write ordering: barrier
Feb 24 14:34:01 bob kernel: block drbd1: max_segment_size ( = BIO size ) = 32768
Feb 24 14:34:01 bob kernel: block drbd1: drbd_bm_resize called with capacity == 2000744
Feb 24 14:34:01 bob kernel: block drbd1: resync bitmap: bits=250093 words=7816
Feb 24 14:34:01 bob kernel: block drbd1: size = 977 MB (1000372 KB)
Feb 24 14:34:01 bob kernel: block drbd1: recounting of set bits took additional 0 jiffies
Feb 24 14:34:01 bob kernel: block drbd1: 0 KB (0 bits) marked out-of-sync by on disk bit-map.
Feb 24 14:34:01 bob kernel: block drbd1: Marked additional 4096 KB as out-of-sync based on AL.
Feb 24 14:34:01 bob kernel: block drbd1: meta data flush failed with status -95, disabling md-flushes
Feb 24 14:34:01 bob kernel: block drbd1: disk( Attaching -> UpToDate ) 
Feb 24 14:34:01 bob kernel: block drbd1: conn( StandAlone -> Unconnected ) 
Feb 24 14:34:01 bob kernel: block drbd1: Starting receiver thread (from drbd1_worker [2727])
Feb 24 14:34:01 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:1:start:stdout)  
Feb 24 14:34:01 bob kernel: block drbd2: Starting worker thread (from cqueue/0 [92])
Feb 24 14:34:01 bob kernel: block drbd2: disk( Diskless -> Attaching ) 
Feb 24 14:34:01 bob kernel: block drbd2: Found 4 transactions (8 active extents) in activity log.
Feb 24 14:34:01 bob kernel: block drbd2: Method to ensure write ordering: barrier
Feb 24 14:34:01 bob kernel: block drbd2: max_segment_size ( = BIO size ) = 32768
Feb 24 14:34:01 bob kernel: block drbd2: drbd_bm_resize called with capacity == 2000744
Feb 24 14:34:01 bob kernel: block drbd2: resync bitmap: bits=250093 words=7816
Feb 24 14:34:01 bob kernel: block drbd2: size = 977 MB (1000372 KB)
Feb 24 14:34:01 bob kernel: block drbd2: recounting of set bits took additional 0 jiffies
Feb 24 14:34:01 bob attrd: [2218]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:34:01 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=df0d4306-9cf3-4c5c-a23a-027ac36da131, magic=NA, cib=0.88.27) : Transient attribute: update
Feb 24 14:34:01 bob kernel: block drbd2: 0 KB (0 bits) marked out-of-sync by on disk bit-map.
Feb 24 14:34:01 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql1:1 (1000)
Feb 24 14:34:01 bob crmd: [2219]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb 24 14:34:01 bob lrmd: [2216]: info: RA output: (res_drbd_mysql2:1:start:stdout)  
Feb 24 14:34:02 alice kernel: drbd: initialized. Version: 8.3.7 (api:88/proto:86-91)
Feb 24 14:34:02 alice kernel: drbd: GIT-hash: ea9e28dbff98e331a62bcbcc63a6135808fe2917 build by buildsystem@linbit, 2010-01-25 11:41:08
Feb 24 14:34:02 alice kernel: drbd: registered as block device major 147
Feb 24 14:34:02 alice kernel: drbd: minor_table @ 0xdd9df460
Feb 24 14:34:02 alice lrmd: [2265]: info: RA output: (res_drbd_mysql1:0:start:stdout)  
Feb 24 14:34:02 alice kernel: block drbd1: Starting worker thread (from cqueue/0 [92])
Feb 24 14:34:02 alice kernel: block drbd1: disk( Diskless -> Attaching ) 
Feb 24 14:34:02 alice kernel: block drbd1: Found 4 transactions (4 active extents) in activity log.
Feb 24 14:34:02 alice kernel: block drbd1: Method to ensure write ordering: barrier
Feb 24 14:34:02 alice kernel: block drbd1: max_segment_size ( = BIO size ) = 32768
Feb 24 14:34:02 alice kernel: block drbd1: drbd_bm_resize called with capacity == 2000744
Feb 24 14:34:02 alice kernel: block drbd1: resync bitmap: bits=250093 words=7816
Feb 24 14:34:02 alice kernel: block drbd1: size = 977 MB (1000372 KB)
Feb 24 14:34:02 alice kernel: block drbd1: recounting of set bits took additional 0 jiffies
Feb 24 14:34:02 alice kernel: block drbd1: 0 KB (0 bits) marked out-of-sync by on disk bit-map.
Feb 24 14:34:02 alice kernel: block drbd1: disk( Attaching -> UpToDate ) 
Feb 24 14:34:02 alice kernel: block drbd1: Barriers not supported on meta data device - disabling
Feb 24 14:34:02 alice lrmd: [2265]: info: RA output: (res_drbd_mysql2:0:start:stdout)  
Feb 24 14:34:02 alice kernel: block drbd2: Starting worker thread (from cqueue/0 [92])
Feb 24 14:34:02 alice kernel: block drbd2: disk( Diskless -> Attaching ) 
Feb 24 14:34:02 alice kernel: block drbd2: Found 4 transactions (8 active extents) in activity log.
Feb 24 14:34:02 alice kernel: block drbd2: Method to ensure write ordering: barrier
Feb 24 14:34:02 alice kernel: block drbd2: max_segment_size ( = BIO size ) = 32768
Feb 24 14:34:02 alice kernel: block drbd2: drbd_bm_resize called with capacity == 2000744
Feb 24 14:34:02 alice kernel: block drbd2: resync bitmap: bits=250093 words=7816
Feb 24 14:34:02 alice lrmd: [2265]: info: RA output: (res_drbd_mysql2:0:start:stdout)  
Feb 24 14:34:02 alice kernel: block drbd2: size = 977 MB (1000372 KB)
Feb 24 14:34:02 alice kernel: block drbd2: recounting of set bits took additional 0 jiffies
Feb 24 14:34:02 alice kernel: block drbd2: 0 KB (0 bits) marked out-of-sync by on disk bit-map.
Feb 24 14:34:02 bob kernel: block drbd2: disk( Attaching -> UpToDate ) 
Feb 24 14:34:02 bob attrd: [2218]: info: attrd_perform_update: Sent update 15: master-res_drbd_mysql1:1=1000
Feb 24 14:34:02 bob crmd: [2219]: info: update_abort_priority: Abort action done superceeded by restart
Feb 24 14:34:02 bob kernel: block drbd2: Barriers not supported on meta data device - disabling
Feb 24 14:34:02 bob attrd: [2218]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:34:02 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=0af1add7-22b5-4342-9816-67e6351605de, magic=NA, cib=0.88.28) : Transient attribute: update
Feb 24 14:34:02 bob lrmd: [2216]: info: RA output: (res_drbd_mysql2:1:start:stdout)  
Feb 24 14:34:02 bob kernel: block drbd1: receiver (re)started
Feb 24 14:34:02 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql2:1 (1000)
Feb 24 14:34:03 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:34:03 alice kernel: block drbd2: Marked additional 12 MB as out-of-sync based on AL.
Feb 24 14:34:03 alice attrd: [2267]: info: find_hash_entry: Creating hash entry for master-res_drbd_mysql1:1
Feb 24 14:34:03 alice kernel: block drbd2: meta data flush failed with status -95, disabling md-flushes
Feb 24 14:34:03 alice kernel: block drbd2: disk( Attaching -> UpToDate ) 
Feb 24 14:34:03 alice kernel: block drbd2: conn( StandAlone -> Unconnected ) 
Feb 24 14:34:03 alice kernel: block drbd2: Starting receiver thread (from drbd2_worker [2757])
Feb 24 14:34:03 alice kernel: block drbd2: receiver (re)started
Feb 24 14:34:03 alice kernel: block drbd2: conn( Unconnected -> WFConnection ) 
Feb 24 14:34:03 alice kernel: block drbd2: Handshake successful: Agreed network protocol version 91
Feb 24 14:34:03 alice kernel: block drbd2: conn( WFConnection -> WFReportParams ) 
Feb 24 14:34:03 alice kernel: block drbd2: Starting asender thread (from drbd2_receiver [2773])
Feb 24 14:34:03 alice kernel: block drbd2: data-integrity-alg: <not-used>
Feb 24 14:34:03 alice kernel: block drbd2: drbd_sync_handshake:
Feb 24 14:34:03 alice kernel: block drbd2: self E932B9E0C848D50E:0000000000000000:F6343AAC236BF5EB:5334D790EB831F48 bits:3072 flags:0
Feb 24 14:34:03 alice kernel: block drbd2: peer E932B9E0C848D50E:0000000000000000:F6343AAC236BF5EA:5334D790EB831F48 bits:0 flags:0
Feb 24 14:34:03 alice kernel: block drbd2: uuid_compare()=1 by rule 40
Feb 24 14:34:03 alice kernel: block drbd2: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpToDate ) 
Feb 24 14:34:03 alice kernel: block drbd2: conn( WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent ) 
Feb 24 14:34:03 alice kernel: block drbd2: Began resync as SyncSource (will sync 12288 KB [3072 bits set]).
Feb 24 14:34:03 alice attrd: [2267]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql2:0 (1000)
Feb 24 14:34:03 alice attrd: [2267]: info: attrd_perform_update: Sent update 18: master-res_drbd_mysql2:0=1000
Feb 24 14:34:03 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:34:03 alice attrd: [2267]: info: find_hash_entry: Creating hash entry for master-res_drbd_mysql2:1
Feb 24 14:34:03 alice lrmd: [2265]: info: RA output: (res_drbd_mysql2:0:start:stdout)  
Feb 24 14:34:03 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql2:0_start_0 (call=15, rc=0, cib-update=23, confirmed=true) ok
Feb 24 14:34:03 alice kernel: block drbd1: conn( StandAlone -> Unconnected ) 
Feb 24 14:34:03 alice kernel: block drbd1: Starting receiver thread (from drbd1_worker [2747])
Feb 24 14:34:03 alice kernel: block drbd1: receiver (re)started
Feb 24 14:34:03 alice kernel: block drbd1: conn( Unconnected -> WFConnection ) 
Feb 24 14:34:03 alice lrmd: [2265]: info: RA output: (res_drbd_mysql1:0:start:stdout)  
Feb 24 14:34:03 bob kernel: block drbd1: conn( Unconnected -> WFConnection ) 
Feb 24 14:34:03 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:1_start_0 (call=14, rc=0, cib-update=41, confirmed=true) ok
Feb 24 14:34:03 bob attrd: [2218]: info: attrd_perform_update: Sent update 20: master-res_drbd_mysql2:1=1000
Feb 24 14:34:03 bob kernel: block drbd2: conn( StandAlone -> Unconnected ) 
Feb 24 14:34:03 bob kernel: block drbd2: Starting receiver thread (from drbd2_worker [2743])
Feb 24 14:34:03 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql2:1_start_0 (call=15, rc=0, cib-update=42, confirmed=true) ok
Feb 24 14:34:03 bob kernel: block drbd2: receiver (re)started
Feb 24 14:34:03 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:1_start_0 (38) confirmed on bob.demo (rc=0)
Feb 24 14:34:03 bob kernel: block drbd2: conn( Unconnected -> WFConnection ) 
Feb 24 14:34:03 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=0af1add7-22b5-4342-9816-67e6351605de, magic=NA, cib=0.88.30) : Transient attribute: update
Feb 24 14:34:03 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:1_start_0 (64) confirmed on bob.demo (rc=0)
Feb 24 14:34:03 bob kernel: block drbd2: Handshake successful: Agreed network protocol version 91
Feb 24 14:34:03 bob kernel: block drbd2: conn( WFConnection -> WFReportParams ) 
Feb 24 14:34:03 bob kernel: block drbd2: Starting asender thread (from drbd2_receiver [2770])
Feb 24 14:34:03 bob kernel: block drbd2: data-integrity-alg: <not-used>
Feb 24 14:34:03 bob kernel: block drbd2: drbd_sync_handshake:
Feb 24 14:34:03 bob kernel: block drbd2: self E932B9E0C848D50E:0000000000000000:F6343AAC236BF5EA:5334D790EB831F48 bits:0 flags:0
Feb 24 14:34:03 bob kernel: block drbd2: peer E932B9E0C848D50E:0000000000000000:F6343AAC236BF5EB:5334D790EB831F48 bits:3072 flags:2
Feb 24 14:34:03 bob kernel: block drbd2: uuid_compare()=-1 by rule 40
Feb 24 14:34:03 bob kernel: block drbd2: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate ) 
Feb 24 14:34:03 bob kernel: block drbd2: conn( WFBitMapT -> WFSyncUUID ) 
Feb 24 14:34:03 bob kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2
Feb 24 14:34:03 bob kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2 exit code 0 (0x0)
Feb 24 14:34:03 bob kernel: block drbd2: conn( WFSyncUUID -> SyncTarget ) disk( UpToDate -> Inconsistent ) 
Feb 24 14:34:03 bob kernel: block drbd2: Began resync as SyncTarget (will sync 12288 KB [3072 bits set]).
Feb 24 14:34:04 alice kernel: block drbd1: Handshake successful: Agreed network protocol version 91
Feb 24 14:34:04 alice kernel: block drbd1: conn( WFConnection -> WFReportParams ) 
Feb 24 14:34:04 alice kernel: block drbd1: Starting asender thread (from drbd1_receiver [2798])
Feb 24 14:34:04 alice kernel: block drbd1: data-integrity-alg: <not-used>
Feb 24 14:34:04 alice attrd: [2267]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql1:0 (1000)
Feb 24 14:34:04 alice attrd: [2267]: info: attrd_perform_update: Sent update 22: master-res_drbd_mysql1:0=1000
Feb 24 14:34:04 alice kernel: block drbd1: drbd_sync_handshake:
Feb 24 14:34:04 alice kernel: block drbd1: self D775F0FC154302D0:0000000000000000:254540738F0F9303:6A95A35985C1F388 bits:0 flags:0
Feb 24 14:34:04 alice kernel: block drbd1: peer 478435E22A668E34:D775F0FC154302D0:254540738F0F9302:6A95A35985C1F388 bits:1024 flags:2
Feb 24 14:34:04 alice kernel: block drbd1: uuid_compare()=-1 by rule 50
Feb 24 14:34:04 alice kernel: block drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate ) 
Feb 24 14:34:04 alice lrmd: [2265]: info: RA output: (res_drbd_mysql1:0:start:stdout)  
Feb 24 14:34:04 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_start_0 (call=14, rc=0, cib-update=24, confirmed=true) ok
Feb 24 14:34:04 alice kernel: block drbd1: conn( WFBitMapT -> WFSyncUUID ) 
Feb 24 14:34:04 bob attrd: [2218]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:34:04 bob attrd: [2218]: info: find_hash_entry: Creating hash entry for master-res_drbd_mysql2:0
Feb 24 14:34:04 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=df0d4306-9cf3-4c5c-a23a-027ac36da131, magic=NA, cib=0.88.32) : Transient attribute: update
Feb 24 14:34:04 bob kernel: block drbd1: Handshake successful: Agreed network protocol version 91
Feb 24 14:34:04 bob kernel: block drbd1: conn( WFConnection -> WFReportParams ) 
Feb 24 14:34:04 bob kernel: block drbd1: Starting asender thread (from drbd1_receiver [2739])
Feb 24 14:34:04 bob kernel: block drbd1: data-integrity-alg: <not-used>
Feb 24 14:34:04 bob kernel: block drbd1: drbd_sync_handshake:
Feb 24 14:34:04 bob kernel: block drbd1: self 478435E22A668E34:D775F0FC154302D0:254540738F0F9302:6A95A35985C1F388 bits:1024 flags:0
Feb 24 14:34:04 bob kernel: block drbd1: peer D775F0FC154302D0:0000000000000000:254540738F0F9303:6A95A35985C1F388 bits:0 flags:0
Feb 24 14:34:04 bob kernel: block drbd1: uuid_compare()=1 by rule 70
Feb 24 14:34:04 bob kernel: block drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpToDate ) 
Feb 24 14:34:05 alice kernel: block drbd1: helper command: /sbin/drbdadm before-resync-target minor-1
Feb 24 14:34:05 alice kernel: block drbd1: helper command: /sbin/drbdadm before-resync-target minor-1 exit code 0 (0x0)
Feb 24 14:34:05 alice kernel: block drbd1: conn( WFSyncUUID -> SyncTarget ) disk( UpToDate -> Inconsistent ) 
Feb 24 14:34:05 alice kernel: block drbd1: Began resync as SyncTarget (will sync 4096 KB [1024 bits set]).
Feb 24 14:34:05 alice lrmd: [2265]: info: rsc:res_drbd_mysql2:0:16: notify
Feb 24 14:34:05 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=137:2:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:0_notify_0 )
Feb 24 14:34:05 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:0_start_0 (63) confirmed on alice.demo (rc=0)
Feb 24 14:34:05 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 66 fired and confirmed
Feb 24 14:34:05 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 69 fired and confirmed
Feb 24 14:34:05 bob crmd: [2219]: info: te_rsc_command: Initiating action 137: notify res_drbd_mysql2:0_post_notify_start_0 on alice.demo
Feb 24 14:34:05 bob crmd: [2219]: info: te_rsc_command: Initiating action 138: notify res_drbd_mysql2:1_post_notify_start_0 on bob.demo (local)
Feb 24 14:34:05 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=138:2:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:1_notify_0 )
Feb 24 14:34:05 bob kernel: block drbd1: conn( WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent ) 
Feb 24 14:34:05 bob kernel: block drbd1: Began resync as SyncSource (will sync 4096 KB [1024 bits set]).
Feb 24 14:34:05 bob lrmd: [2216]: info: rsc:res_drbd_mysql2:1:16: notify
Feb 24 14:34:05 bob attrd: [2218]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:34:05 bob attrd: [2218]: info: find_hash_entry: Creating hash entry for master-res_drbd_mysql1:0
Feb 24 14:34:05 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=df0d4306-9cf3-4c5c-a23a-027ac36da131, magic=NA, cib=0.88.34) : Transient attribute: update
Feb 24 14:34:05 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_start_0 (37) confirmed on alice.demo (rc=0)
Feb 24 14:34:05 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 40 fired and confirmed
Feb 24 14:34:05 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 43 fired and confirmed
Feb 24 14:34:05 bob crmd: [2219]: info: te_rsc_command: Initiating action 133: notify res_drbd_mysql1:0_post_notify_start_0 on alice.demo
Feb 24 14:34:05 bob crmd: [2219]: info: te_rsc_command: Initiating action 134: notify res_drbd_mysql1:1_post_notify_start_0 on bob.demo (local)
Feb 24 14:34:05 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=134:2:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:1_notify_0 )
Feb 24 14:34:05 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:1:17: notify
Feb 24 14:34:06 alice lrmd: [2265]: info: RA output: (res_drbd_mysql2:0:notify:stdout) drbdsetup 2 syncer --set-defaults --create-device --rate=10M  
Feb 24 14:34:06 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql2:0_notify_0 (call=16, rc=0, cib-update=25, confirmed=true) ok
Feb 24 14:34:06 alice lrmd: [2265]: info: rsc:res_drbd_mysql1:0:17: notify
Feb 24 14:34:06 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=133:2:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_notify_0 )
Feb 24 14:34:06 alice kernel: block drbd1: Resync done (total 1 sec; paused 0 sec; 4096 K/sec)
Feb 24 14:34:06 alice kernel: block drbd1: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate ) 
Feb 24 14:34:06 alice kernel: block drbd1: helper command: /sbin/drbdadm after-resync-target minor-1
Feb 24 14:34:06 bob lrmd: [2216]: info: RA output: (res_drbd_mysql2:1:notify:stdout) drbdsetup 2 syncer --set-defaults --create-device --rate=10M  
Feb 24 14:34:06 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql2:1_notify_0 (call=16, rc=0, cib-update=43, confirmed=true) ok
Feb 24 14:34:06 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:1_post_notify_start_0 (138) confirmed on bob.demo (rc=0)
Feb 24 14:34:06 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device --rate=10M  
Feb 24 14:34:06 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:1_notify_0 (call=17, rc=0, cib-update=44, confirmed=true) ok
Feb 24 14:34:06 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:1_post_notify_start_0 (134) confirmed on bob.demo (rc=0)
Feb 24 14:34:06 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:0_post_notify_start_0 (137) confirmed on alice.demo (rc=0)
Feb 24 14:34:06 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 70 fired and confirmed
Feb 24 14:34:06 bob kernel: block drbd1: Resync done (total 1 sec; paused 0 sec; 4096 K/sec)
Feb 24 14:34:06 bob kernel: block drbd1: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate ) 
Feb 24 14:34:07 alice kernel: block drbd1: helper command: /sbin/drbdadm after-resync-target minor-1 exit code 0 (0x0)
Feb 24 14:34:07 alice lrmd: [2265]: info: RA output: (res_drbd_mysql1:0:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device --rate=10M  
Feb 24 14:34:07 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_notify_0 (call=17, rc=0, cib-update=26, confirmed=true) ok
Feb 24 14:34:07 alice kernel: block drbd2: Resync done (total 4 sec; paused 0 sec; 3072 K/sec)
Feb 24 14:34:07 alice kernel: block drbd2: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate ) 
Feb 24 14:34:07 bob kernel: block drbd2: Resync done (total 4 sec; paused 0 sec; 3072 K/sec)
Feb 24 14:34:07 bob kernel: block drbd2: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate ) 
Feb 24 14:34:07 bob kernel: block drbd2: helper command: /sbin/drbdadm after-resync-target minor-2
Feb 24 14:34:08 bob kernel: block drbd2: helper command: /sbin/drbdadm after-resync-target minor-2 exit code 0 (0x0)
Feb 24 14:34:08 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_post_notify_start_0 (133) confirmed on alice.demo (rc=0)
Feb 24 14:34:08 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 44 fired and confirmed
Feb 24 14:34:08 bob crmd: [2219]: info: run_graph: ====================================================
Feb 24 14:34:08 bob crmd: [2219]: notice: run_graph: Transition 2 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-warn-93.bz2): Complete
Feb 24 14:34:08 bob crmd: [2219]: info: te_graph_trigger: Transition 2 is now complete
Feb 24 14:34:08 bob crmd: [2219]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb 24 14:34:08 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 24 14:34:08 bob crmd: [2219]: info: do_pe_invoke: Query 45: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:34:08 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:34:08 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:34:08 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:34:08 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:34:08 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:34:08 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:34:08 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=45, ref=pe_calc-dc-1267018448-48, seq=2, quorate=1
Feb 24 14:34:08 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:34:08 bob pengine: [2329]: notice: short_print:      Slaves: [ alice.demo bob.demo ]
Feb 24 14:34:08 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:34:08 bob pengine: [2329]: notice: short_print:      Slaves: [ alice.demo bob.demo ]
Feb 24 14:34:08 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Slave alice.demo)
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Slave alice.demo)
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_drbd_mysql1:1 cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_fs_mysql1 cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_ip_mysql1: Rolling back scores from res_mysql1
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_ip_mysql1 cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: WARN: native_color: Resource res_mysql1 cannot run anywhere
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Slave alice.demo)
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Slave alice.demo)
Feb 24 14:34:08 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:08 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:08 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_fs_mysql2 on alice.demo
Feb 24 14:34:08 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_ip_mysql2 on alice.demo
Feb 24 14:34:08 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_mysql2 on alice.demo
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql1	(Stopped)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql1	(Stopped)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql1	(Stopped)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Move resource res_drbd_mysql1:0	(Slave alice.demo -> bob.demo)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Stop resource res_drbd_mysql1:1	(bob.demo)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Promote res_drbd_mysql2:0	(Slave -> Master alice.demo)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:1	(Slave bob.demo)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Start res_fs_mysql2	(alice.demo)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Start res_ip_mysql2	(alice.demo)
Feb 24 14:34:08 bob pengine: [2329]: notice: LogActions: Start res_mysql2	(alice.demo)
Feb 24 14:34:08 bob crmd: [2219]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb 24 14:34:08 bob pengine: [2329]: WARN: process_pe_message: Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-94.bz2
Feb 24 14:34:08 bob crmd: [2219]: info: unpack_graph: Unpacked transition 3: 38 actions in 38 synapses
Feb 24 14:34:08 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:34:08 bob crmd: [2219]: info: do_te_invoke: Processing graph 3 (ref=pe_calc-dc-1267018448-48) derived from /var/lib/pengine/pe-warn-94.bz2
Feb 24 14:34:08 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 49 fired and confirmed
Feb 24 14:34:08 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 86 fired and confirmed
Feb 24 14:34:08 bob crmd: [2219]: info: te_rsc_command: Initiating action 137: notify res_drbd_mysql1:0_pre_notify_stop_0 on alice.demo
Feb 24 14:34:08 bob crmd: [2219]: info: te_rsc_command: Initiating action 138: notify res_drbd_mysql1:1_pre_notify_stop_0 on bob.demo (local)
Feb 24 14:34:08 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=138:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:1_notify_0 )
Feb 24 14:34:08 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:1:18: notify
Feb 24 14:34:08 bob crmd: [2219]: info: te_rsc_command: Initiating action 152: notify res_drbd_mysql2:0_pre_notify_promote_0 on alice.demo
Feb 24 14:34:09 alice lrmd: [2265]: info: rsc:res_drbd_mysql1:0:18: notify
Feb 24 14:34:09 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=137:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_notify_0 )
Feb 24 14:34:09 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=152:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:0_notify_0 )
Feb 24 14:34:09 alice lrmd: [2265]: info: rsc:res_drbd_mysql2:0:19: notify
Feb 24 14:34:09 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql2:0_notify_0 (call=19, rc=0, cib-update=27, confirmed=true) ok
Feb 24 14:34:09 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_notify_0 (call=18, rc=0, cib-update=28, confirmed=true) ok
Feb 24 14:34:09 bob crmd: [2219]: info: te_rsc_command: Initiating action 154: notify res_drbd_mysql2:1_pre_notify_promote_0 on bob.demo (local)
Feb 24 14:34:09 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=154:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:1_notify_0 )
Feb 24 14:34:09 bob lrmd: [2216]: info: rsc:res_drbd_mysql2:1:19: notify
Feb 24 14:34:09 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:1_notify_0 (call=18, rc=0, cib-update=46, confirmed=true) ok
Feb 24 14:34:09 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:1_pre_notify_stop_0 (138) confirmed on bob.demo (rc=0)
Feb 24 14:34:09 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql2:1_notify_0 (call=19, rc=0, cib-update=47, confirmed=true) ok
Feb 24 14:34:09 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:1_pre_notify_promote_0 (154) confirmed on bob.demo (rc=0)
Feb 24 14:34:10 alice kernel: block drbd1: peer( Secondary -> Unknown ) conn( Connected -> TearDown ) pdsk( UpToDate -> DUnknown ) 
Feb 24 14:34:10 alice kernel: block drbd1: asender terminated
Feb 24 14:34:10 alice kernel: block drbd1: Terminating asender thread
Feb 24 14:34:10 alice kernel: block drbd1: Connection closed
Feb 24 14:34:10 alice kernel: block drbd1: conn( TearDown -> Unconnected ) 
Feb 24 14:34:10 alice kernel: block drbd1: receiver terminated
Feb 24 14:34:10 alice kernel: block drbd1: Restarting receiver thread
Feb 24 14:34:10 alice kernel: block drbd1: receiver (re)started
Feb 24 14:34:10 alice kernel: block drbd1: conn( Unconnected -> WFConnection ) 
Feb 24 14:34:10 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:0_pre_notify_promote_0 (152) confirmed on alice.demo (rc=0)
Feb 24 14:34:10 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 87 fired and confirmed
Feb 24 14:34:10 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 84 fired and confirmed
Feb 24 14:34:10 bob crmd: [2219]: info: te_rsc_command: Initiating action 68: promote res_drbd_mysql2:0_promote_0 on alice.demo
Feb 24 14:34:10 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_pre_notify_stop_0 (137) confirmed on alice.demo (rc=0)
Feb 24 14:34:10 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 50 fired and confirmed
Feb 24 14:34:10 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 47 fired and confirmed
Feb 24 14:34:10 bob crmd: [2219]: info: te_rsc_command: Initiating action 38: stop res_drbd_mysql1:0_stop_0 on alice.demo
Feb 24 14:34:10 bob crmd: [2219]: info: te_rsc_command: Initiating action 40: stop res_drbd_mysql1:1_stop_0 on bob.demo (local)
Feb 24 14:34:10 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=40:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:1_stop_0 )
Feb 24 14:34:10 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:1:20: stop
Feb 24 14:34:10 bob kernel: block drbd1: peer( Secondary -> Unknown ) conn( Connected -> Disconnecting ) pdsk( UpToDate -> DUnknown ) 
Feb 24 14:34:10 bob kernel: block drbd1: short read expecting header on sock: r=-512
Feb 24 14:34:10 bob kernel: block drbd1: asender terminated
Feb 24 14:34:10 bob kernel: block drbd1: Terminating asender thread
Feb 24 14:34:10 bob kernel: block drbd1: Connection closed
Feb 24 14:34:10 bob kernel: block drbd1: conn( Disconnecting -> StandAlone ) 
Feb 24 14:34:10 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:1:stop:stdout)  
Feb 24 14:34:10 bob kernel: block drbd1: receiver terminated
Feb 24 14:34:10 bob kernel: block drbd1: Terminating receiver thread
Feb 24 14:34:10 bob kernel: block drbd1: disk( UpToDate -> Diskless ) 
Feb 24 14:34:10 bob kernel: block drbd1: drbd_bm_resize called with capacity == 0
Feb 24 14:34:10 bob kernel: block drbd1: worker terminated
Feb 24 14:34:10 bob kernel: block drbd1: Terminating worker thread
Feb 24 14:34:10 bob crm_attribute: [2949]: WARN: Initializing connection to logging daemon failed. Logging daemon may not be running
Feb 24 14:34:10 bob crm_attribute: [2949]: info: Invoked: crm_attribute -N bob.demo -n master-res_drbd_mysql1:1 -l reboot -D 
Feb 24 14:34:10 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql1:1 (<null>)
Feb 24 14:34:10 bob attrd: [2218]: info: attrd_perform_update: Sent delete 24: node=0af1add7-22b5-4342-9816-67e6351605de, attr=master-res_drbd_mysql1:1, id=<n/a>, set=(null), section=status
Feb 24 14:34:10 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=0af1add7-22b5-4342-9816-67e6351605de, magic=NA, cib=0.88.44) : Transient attribute: removal
Feb 24 14:34:10 bob crmd: [2219]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb 24 14:34:10 bob crmd: [2219]: info: update_abort_priority: Abort action done superceeded by restart
Feb 24 14:34:10 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:1:stop:stdout)  
Feb 24 14:34:10 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:1_stop_0 (call=20, rc=0, cib-update=48, confirmed=true) ok
Feb 24 14:34:10 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:1_stop_0 (40) confirmed on bob.demo (rc=0)
Feb 24 14:34:10 bob attrd: [2218]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:34:11 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:34:11 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=68:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:0_promote_0 )
Feb 24 14:34:11 alice lrmd: [2265]: info: rsc:res_drbd_mysql2:0:20: promote
Feb 24 14:34:11 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=38:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_stop_0 )
Feb 24 14:34:11 alice lrmd: [2265]: info: rsc:res_drbd_mysql1:0:21: stop
Feb 24 14:34:11 alice kernel: block drbd2: role( Secondary -> Primary ) 
Feb 24 14:34:11 alice kernel: block drbd1: conn( WFConnection -> Disconnecting ) 
Feb 24 14:34:11 alice kernel: block drbd1: Discarding network configuration.
Feb 24 14:34:11 alice kernel: block drbd1: Connection closed
Feb 24 14:34:11 alice kernel: block drbd1: conn( Disconnecting -> StandAlone ) 
Feb 24 14:34:11 alice kernel: block drbd1: receiver terminated
Feb 24 14:34:11 alice kernel: block drbd1: Terminating receiver thread
Feb 24 14:34:11 alice kernel: block drbd1: disk( UpToDate -> Diskless ) 
Feb 24 14:34:11 alice kernel: block drbd1: drbd_bm_resize called with capacity == 0
Feb 24 14:34:11 alice kernel: block drbd1: worker terminated
Feb 24 14:34:11 alice kernel: block drbd1: Terminating worker thread
Feb 24 14:34:11 alice lrmd: [2265]: info: RA output: (res_drbd_mysql2:0:promote:stdout)  
Feb 24 14:34:11 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql2:0_promote_0 (call=20, rc=0, cib-update=29, confirmed=true) ok
Feb 24 14:34:11 alice lrmd: [2265]: info: RA output: (res_drbd_mysql1:0:stop:stdout)  
Feb 24 14:34:11 alice crm_attribute: [2971]: info: Invoked: crm_attribute -N alice.demo -n master-res_drbd_mysql1:0 -l reboot -D 
Feb 24 14:34:11 alice attrd: [2267]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql1:0 (<null>)
Feb 24 14:34:11 alice attrd: [2267]: info: attrd_perform_update: Sent delete 25: node=df0d4306-9cf3-4c5c-a23a-027ac36da131, attr=master-res_drbd_mysql1:0, id=<n/a>, set=(null), section=status
Feb 24 14:34:11 alice lrmd: [2265]: info: RA output: (res_drbd_mysql1:0:stop:stdout)  
Feb 24 14:34:11 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_stop_0 (call=21, rc=0, cib-update=30, confirmed=true) ok
Feb 24 14:34:11 alice attrd: [2267]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:34:11 alice attrd: [2267]: info: attrd_perform_update: Sent delete 27: node=df0d4306-9cf3-4c5c-a23a-027ac36da131, attr=master-res_drbd_mysql1:0, id=<n/a>, set=(null), section=status
Feb 24 14:34:11 bob kernel: block drbd2: peer( Secondary -> Primary ) 
Feb 24 14:34:11 bob attrd: [2218]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:34:11 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:0_promote_0 (68) confirmed on alice.demo (rc=0)
Feb 24 14:34:11 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 85 fired and confirmed
Feb 24 14:34:11 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 88 fired and confirmed
Feb 24 14:34:11 bob crmd: [2219]: info: te_rsc_command: Initiating action 153: notify res_drbd_mysql2:0_post_notify_promote_0 on alice.demo
Feb 24 14:34:11 bob crmd: [2219]: info: te_rsc_command: Initiating action 155: notify res_drbd_mysql2:1_post_notify_promote_0 on bob.demo (local)
Feb 24 14:34:11 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=155:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:1_notify_0 )
Feb 24 14:34:11 bob lrmd: [2216]: info: rsc:res_drbd_mysql2:1:21: notify
Feb 24 14:34:11 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=df0d4306-9cf3-4c5c-a23a-027ac36da131, magic=NA, cib=0.88.47) : Transient attribute: removal
Feb 24 14:34:11 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_stop_0 (38) confirmed on alice.demo (rc=0)
Feb 24 14:34:11 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 48 fired and confirmed
Feb 24 14:34:11 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 51 fired and confirmed
Feb 24 14:34:11 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 52 fired and confirmed
Feb 24 14:34:11 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql2:1 (10000)
Feb 24 14:34:11 bob attrd: [2218]: info: attrd_perform_update: Sent update 28: master-res_drbd_mysql2:1=10000
Feb 24 14:34:11 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=0af1add7-22b5-4342-9816-67e6351605de, magic=NA, cib=0.88.49) : Transient attribute: update
Feb 24 14:34:11 bob lrmd: [2216]: info: RA output: (res_drbd_mysql2:1:notify:stdout)  
Feb 24 14:34:11 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql2:1_notify_0 (call=21, rc=0, cib-update=49, confirmed=true) ok
Feb 24 14:34:11 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:1_post_notify_promote_0 (155) confirmed on bob.demo (rc=0)
Feb 24 14:34:12 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:34:12 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=153:3:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql2:0_notify_0 )
Feb 24 14:34:12 alice lrmd: [2265]: info: rsc:res_drbd_mysql2:0:22: notify
Feb 24 14:34:12 alice attrd: [2267]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql2:0 (10000)
Feb 24 14:34:12 alice attrd: [2267]: info: attrd_perform_update: Sent update 30: master-res_drbd_mysql2:0=10000
Feb 24 14:34:12 alice lrmd: [2265]: info: RA output: (res_drbd_mysql2:0:notify:stdout)  
Feb 24 14:34:12 alice crmd: [2268]: info: process_lrm_event: LRM operation res_drbd_mysql2:0_notify_0 (call=22, rc=0, cib-update=31, confirmed=true) ok
Feb 24 14:34:12 bob attrd: [2218]: info: attrd_ha_callback: flush message from alice.demo
Feb 24 14:34:12 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=df0d4306-9cf3-4c5c-a23a-027ac36da131, magic=NA, cib=0.88.51) : Transient attribute: update
Feb 24 14:34:12 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql2:0_post_notify_promote_0 (153) confirmed on alice.demo (rc=0)
Feb 24 14:34:12 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 89 fired and confirmed
Feb 24 14:34:12 bob crmd: [2219]: info: run_graph: ====================================================
Feb 24 14:34:12 bob crmd: [2219]: notice: run_graph: Transition 3 (Complete=21, Pending=0, Fired=0, Skipped=13, Incomplete=4, Source=/var/lib/pengine/pe-warn-94.bz2): Stopped
Feb 24 14:34:12 bob crmd: [2219]: info: te_graph_trigger: Transition 3 is now complete
Feb 24 14:34:12 bob crmd: [2219]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb 24 14:34:12 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 24 14:34:12 bob crmd: [2219]: info: do_pe_invoke: Query 50: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:34:12 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=50, ref=pe_calc-dc-1267018452-58, seq=2, quorate=1
Feb 24 14:34:12 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:34:12 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:34:12 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:34:12 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:34:12 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:34:12 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:34:12 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:34:12 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql1:0 res_drbd_mysql1:1 ]
Feb 24 14:34:12 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:34:12 bob pengine: [2329]: notice: short_print:      Masters: [ alice.demo ]
Feb 24 14:34:12 bob pengine: [2329]: notice: short_print:      Slaves: [ bob.demo ]
Feb 24 14:34:12 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:12 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:34:12 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:12 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:12 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:12 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:34:12 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:34:12 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:12 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:13 bob pengine: [2329]: WARN: native_color: Resource res_drbd_mysql1:1 cannot run anywhere
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:13 bob pengine: [2329]: WARN: native_color: Resource res_fs_mysql1 cannot run anywhere
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_ip_mysql1: Rolling back scores from res_mysql1
Feb 24 14:34:13 bob pengine: [2329]: WARN: native_color: Resource res_ip_mysql1 cannot run anywhere
Feb 24 14:34:13 bob pengine: [2329]: WARN: native_color: Resource res_mysql1 cannot run anywhere
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:13 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:13 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:13 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_fs_mysql2 on alice.demo
Feb 24 14:34:13 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_ip_mysql2 on alice.demo
Feb 24 14:34:13 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_mysql2 on alice.demo
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql1	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql1	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql1	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Start res_drbd_mysql1:0	(bob.demo)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql1:1	(Stopped)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:0	(Master alice.demo)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:1	(Slave bob.demo)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Start res_fs_mysql2	(alice.demo)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Start res_ip_mysql2	(alice.demo)
Feb 24 14:34:13 bob pengine: [2329]: notice: LogActions: Start res_mysql2	(alice.demo)
Feb 24 14:34:13 bob crmd: [2219]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb 24 14:34:13 bob crmd: [2219]: info: unpack_graph: Unpacked transition 4: 16 actions in 16 synapses
Feb 24 14:34:13 bob crmd: [2219]: info: do_te_invoke: Processing graph 4 (ref=pe_calc-dc-1267018452-58) derived from /var/lib/pengine/pe-warn-95.bz2
Feb 24 14:34:13 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 40 fired and confirmed
Feb 24 14:34:13 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 41 fired and confirmed
Feb 24 14:34:13 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 99 fired and confirmed
Feb 24 14:34:13 bob crmd: [2219]: info: te_rsc_command: Initiating action 93: start res_fs_mysql2_start_0 on alice.demo
Feb 24 14:34:13 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 38 fired and confirmed
Feb 24 14:34:13 bob crmd: [2219]: info: te_rsc_command: Initiating action 37: start res_drbd_mysql1:0_start_0 on bob.demo (local)
Feb 24 14:34:13 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=37:4:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_start_0 )
Feb 24 14:34:13 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:0:22: start
Feb 24 14:34:13 bob pengine: [2329]: WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-95.bz2
Feb 24 14:34:13 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:34:13 bob kernel: block drbd1: Starting worker thread (from cqueue/0 [92])
Feb 24 14:34:13 bob kernel: block drbd1: disk( Diskless -> Attaching ) 
Feb 24 14:34:13 bob kernel: block drbd1: Found 4 transactions (4 active extents) in activity log.
Feb 24 14:34:13 bob kernel: block drbd1: Method to ensure write ordering: barrier
Feb 24 14:34:13 bob kernel: block drbd1: max_segment_size ( = BIO size ) = 32768
Feb 24 14:34:13 bob kernel: block drbd1: drbd_bm_resize called with capacity == 2000744
Feb 24 14:34:13 bob kernel: block drbd1: resync bitmap: bits=250093 words=7816
Feb 24 14:34:13 bob kernel: block drbd1: size = 977 MB (1000372 KB)
Feb 24 14:34:13 bob kernel: block drbd1: recounting of set bits took additional 0 jiffies
Feb 24 14:34:13 bob kernel: block drbd1: 0 KB (0 bits) marked out-of-sync by on disk bit-map.
Feb 24 14:34:13 bob kernel: block drbd1: disk( Attaching -> UpToDate ) 
Feb 24 14:34:13 bob kernel: block drbd1: Barriers not supported on meta data device - disabling
Feb 24 14:34:13 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:0:start:stdout)  
Feb 24 14:34:13 bob kernel: block drbd1: conn( StandAlone -> Unconnected ) 
Feb 24 14:34:13 bob kernel: block drbd1: Starting receiver thread (from drbd1_worker [3005])
Feb 24 14:34:13 bob kernel: block drbd1: receiver (re)started
Feb 24 14:34:13 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql1:0 (1000)
Feb 24 14:34:13 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:0:start:stdout)  
Feb 24 14:34:13 bob kernel: block drbd1: conn( Unconnected -> WFConnection ) 
Feb 24 14:34:13 bob attrd: [2218]: info: attrd_perform_update: Sent update 32: master-res_drbd_mysql1:0=1000
Feb 24 14:34:13 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_start_0 (call=22, rc=0, cib-update=51, confirmed=true) ok
Feb 24 14:34:13 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=0af1add7-22b5-4342-9816-67e6351605de, magic=NA, cib=0.88.53) : Transient attribute: update
Feb 24 14:34:13 bob crmd: [2219]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb 24 14:34:13 bob crmd: [2219]: info: update_abort_priority: Abort action done superceeded by restart
Feb 24 14:34:13 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_start_0 (37) confirmed on bob.demo (rc=0)
Feb 24 14:34:13 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 39 fired and confirmed
Feb 24 14:34:13 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 42 fired and confirmed
Feb 24 14:34:13 bob crmd: [2219]: info: te_rsc_command: Initiating action 136: notify res_drbd_mysql1:0_post_notify_start_0 on bob.demo (local)
Feb 24 14:34:13 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=136:4:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_notify_0 )
Feb 24 14:34:13 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:0:23: notify
Feb 24 14:34:14 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:34:14 alice lrmd: [2265]: info: rsc:res_fs_mysql2:23: start
Feb 24 14:34:14 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=93:4:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_mysql2_start_0 )
Feb 24 14:34:14 alice Filesystem[2999]: [3032]: INFO: Running start for /dev/drbd/by-res/mysql2 on /var/lib/mysql2
Feb 24 14:34:14 alice kernel: kjournald starting.  Commit interval 5 seconds
Feb 24 14:34:14 alice kernel: EXT3 FS on drbd2, internal journal
Feb 24 14:34:14 alice kernel: EXT3-fs: recovery complete.
Feb 24 14:34:14 alice kernel: EXT3-fs: mounted filesystem with ordered data mode.
Feb 24 14:34:14 alice crmd: [2268]: info: process_lrm_event: LRM operation res_fs_mysql2_start_0 (call=23, rc=0, cib-update=32, confirmed=true) ok
Feb 24 14:34:14 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:0:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device --rate=10M  
Feb 24 14:34:14 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_notify_0 (call=23, rc=0, cib-update=52, confirmed=true) ok
Feb 24 14:34:14 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_post_notify_start_0 (136) confirmed on bob.demo (rc=0)
Feb 24 14:34:14 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 43 fired and confirmed
Feb 24 14:34:14 bob kernel: block drbd2: write: error=-95 s=0s
Feb 24 14:34:14 bob kernel: block drbd2: Method to ensure write ordering: flush
Feb 24 14:34:14 bob kernel: block drbd2: local disk flush failed with status -95
Feb 24 14:34:14 bob kernel: block drbd2: Method to ensure write ordering: drain
Feb 24 14:34:14 bob crmd: [2219]: info: match_graph_event: Action res_fs_mysql2_start_0 (93) confirmed on alice.demo (rc=0)
Feb 24 14:34:14 bob crmd: [2219]: info: run_graph: ====================================================
Feb 24 14:34:14 bob crmd: [2219]: notice: run_graph: Transition 4 (Complete=10, Pending=0, Fired=0, Skipped=6, Incomplete=0, Source=/var/lib/pengine/pe-warn-95.bz2): Stopped
Feb 24 14:34:14 bob crmd: [2219]: info: te_graph_trigger: Transition 4 is now complete
Feb 24 14:34:14 bob crmd: [2219]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb 24 14:34:14 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 24 14:34:14 bob crmd: [2219]: info: do_pe_invoke: Query 53: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:34:14 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=53, ref=pe_calc-dc-1267018454-62, seq=2, quorate=1
Feb 24 14:34:14 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:34:14 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:34:14 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:34:14 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:34:14 bob pengine: [2329]: info: find_clone: Internally renamed res_drbd_mysql1:0 on alice.demo to res_drbd_mysql1:1
Feb 24 14:34:14 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:34:14 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:34:14 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:34:14 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:14 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:34:14 bob pengine: [2329]: notice: short_print:      Slaves: [ bob.demo ]
Feb 24 14:34:14 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql1:1 ]
Feb 24 14:34:14 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:34:14 bob pengine: [2329]: notice: short_print:      Masters: [ alice.demo ]
Feb 24 14:34:14 bob pengine: [2329]: notice: short_print:      Slaves: [ bob.demo ]
Feb 24 14:34:14 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Started alice.demo
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:14 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:14 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:34:14 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:14 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:14 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:14 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:34:14 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:34:14 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:14 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:15 bob pengine: [2329]: WARN: native_color: Resource res_drbd_mysql1:1 cannot run anywhere
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql1:0 (Slave bob.demo)
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql1:0 (Slave bob.demo)
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:15 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:15 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_fs_mysql1 on bob.demo
Feb 24 14:34:15 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_ip_mysql1 on bob.demo
Feb 24 14:34:15 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_mysql1 on bob.demo
Feb 24 14:34:15 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_fs_mysql2 on alice.demo
Feb 24 14:34:15 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_ip_mysql2 on alice.demo
Feb 24 14:34:15 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_mysql2 on alice.demo
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Start res_fs_mysql1	(bob.demo)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Start res_ip_mysql1	(bob.demo)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Start res_mysql1	(bob.demo)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Promote res_drbd_mysql1:0	(Slave -> Master bob.demo)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql1:1	(Stopped)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:0	(Master alice.demo)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:1	(Slave bob.demo)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql2	(Started alice.demo)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Start res_ip_mysql2	(alice.demo)
Feb 24 14:34:15 bob pengine: [2329]: notice: LogActions: Start res_mysql2	(alice.demo)
Feb 24 14:34:15 bob crmd: [2219]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb 24 14:34:15 bob pengine: [2329]: WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-96.bz2
Feb 24 14:34:15 bob crmd: [2219]: info: unpack_graph: Unpacked transition 5: 24 actions in 24 synapses
Feb 24 14:34:15 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:34:15 bob crmd: [2219]: info: do_te_invoke: Processing graph 5 (ref=pe_calc-dc-1267018454-62) derived from /var/lib/pengine/pe-warn-96.bz2
Feb 24 14:34:15 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 61 fired and confirmed
Feb 24 14:34:15 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 109 fired and confirmed
Feb 24 14:34:15 bob crmd: [2219]: info: te_rsc_command: Initiating action 104: monitor res_fs_mysql2_monitor_15000 on alice.demo
Feb 24 14:34:15 bob crmd: [2219]: info: te_rsc_command: Initiating action 105: start res_ip_mysql2_start_0 on alice.demo
Feb 24 14:34:15 bob crmd: [2219]: info: te_rsc_command: Initiating action 143: notify res_drbd_mysql1:0_pre_notify_promote_0 on bob.demo (local)
Feb 24 14:34:15 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=143:5:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_notify_0 )
Feb 24 14:34:15 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:0:24: notify
Feb 24 14:34:16 alice lrmd: [2265]: info: rsc:res_fs_mysql2:24: monitor
Feb 24 14:34:16 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=104:5:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_mysql2_monitor_15000 )
Feb 24 14:34:16 alice lrmd: [2265]: info: rsc:res_ip_mysql2:25: start
Feb 24 14:34:16 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=105:5:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_mysql2_start_0 )
Feb 24 14:34:16 alice IPaddr2[3056]: [3120]: INFO: ip -f inet addr add 192.168.122.108/24 brd 192.168.122.255 dev eth0
Feb 24 14:34:16 alice avahi-daemon[2234]: Registering new address record for 192.168.122.108 on eth0.
Feb 24 14:34:16 alice crmd: [2268]: info: process_lrm_event: LRM operation res_fs_mysql2_monitor_15000 (call=24, rc=0, cib-update=33, confirmed=false) ok
Feb 24 14:34:16 alice IPaddr2[3056]: [3123]: INFO: ip link set eth0 up
Feb 24 14:34:16 alice IPaddr2[3056]: [3125]: INFO: /usr/lib/heartbeat/send_arp -i 200 -r 5 -p /var/run/heartbeat/rsctmp/send_arp/send_arp-192.168.122.108 eth0 192.168.122.108 auto not_used not_used
Feb 24 14:34:16 alice crmd: [2268]: info: process_lrm_event: LRM operation res_ip_mysql2_start_0 (call=25, rc=0, cib-update=34, confirmed=true) ok
Feb 24 14:34:16 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_notify_0 (call=24, rc=0, cib-update=54, confirmed=true) ok
Feb 24 14:34:16 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_pre_notify_promote_0 (143) confirmed on bob.demo (rc=0)
Feb 24 14:34:16 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 62 fired and confirmed
Feb 24 14:34:16 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 59 fired and confirmed
Feb 24 14:34:16 bob crmd: [2219]: info: te_rsc_command: Initiating action 46: promote res_drbd_mysql1:0_promote_0 on bob.demo (local)
Feb 24 14:34:16 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=46:5:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_promote_0 )
Feb 24 14:34:16 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:0:25: promote
Feb 24 14:34:16 bob kernel: block drbd1: role( Secondary -> Primary ) 
Feb 24 14:34:16 bob kernel: block drbd1: Creating new current UUID
Feb 24 14:34:16 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:0:promote:stdout)  
Feb 24 14:34:16 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_promote_0 (call=25, rc=0, cib-update=55, confirmed=true) ok
Feb 24 14:34:16 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_promote_0 (46) confirmed on bob.demo (rc=0)
Feb 24 14:34:16 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 60 fired and confirmed
Feb 24 14:34:16 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 63 fired and confirmed
Feb 24 14:34:16 bob crmd: [2219]: info: te_rsc_command: Initiating action 144: notify res_drbd_mysql1:0_post_notify_promote_0 on bob.demo (local)
Feb 24 14:34:16 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=144:5:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_drbd_mysql1:0_notify_0 )
Feb 24 14:34:16 bob lrmd: [2216]: info: rsc:res_drbd_mysql1:0:26: notify
Feb 24 14:34:16 bob crmd: [2219]: info: match_graph_event: Action res_fs_mysql2_monitor_15000 (104) confirmed on alice.demo (rc=0)
Feb 24 14:34:16 bob attrd: [2218]: info: attrd_trigger_update: Sending flush op to all hosts for: master-res_drbd_mysql1:0 (10000)
Feb 24 14:34:16 bob attrd: [2218]: info: attrd_perform_update: Sent update 34: master-res_drbd_mysql1:0=10000
Feb 24 14:34:16 bob crmd: [2219]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=0af1add7-22b5-4342-9816-67e6351605de, magic=NA, cib=0.88.60) : Transient attribute: update
Feb 24 14:34:16 bob crmd: [2219]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb 24 14:34:16 bob crmd: [2219]: info: update_abort_priority: Abort action done superceeded by restart
Feb 24 14:34:16 bob lrmd: [2216]: info: RA output: (res_drbd_mysql1:0:notify:stdout)  
Feb 24 14:34:16 bob crmd: [2219]: info: process_lrm_event: LRM operation res_drbd_mysql1:0_notify_0 (call=26, rc=0, cib-update=56, confirmed=true) ok
Feb 24 14:34:16 bob crmd: [2219]: info: match_graph_event: Action res_drbd_mysql1:0_post_notify_promote_0 (144) confirmed on bob.demo (rc=0)
Feb 24 14:34:16 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 64 fired and confirmed
Feb 24 14:34:17 alice attrd: [2267]: info: attrd_ha_callback: flush message from bob.demo
Feb 24 14:34:17 bob crmd: [2219]: info: match_graph_event: Action res_ip_mysql2_start_0 (105) confirmed on alice.demo (rc=0)
Feb 24 14:34:17 bob crmd: [2219]: info: run_graph: ====================================================
Feb 24 14:34:17 bob crmd: [2219]: notice: run_graph: Transition 5 (Complete=12, Pending=0, Fired=0, Skipped=12, Incomplete=0, Source=/var/lib/pengine/pe-warn-96.bz2): Stopped
Feb 24 14:34:17 bob crmd: [2219]: info: te_graph_trigger: Transition 5 is now complete
Feb 24 14:34:17 bob crmd: [2219]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb 24 14:34:17 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 24 14:34:17 bob crmd: [2219]: info: do_pe_invoke: Query 57: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:34:17 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=57, ref=pe_calc-dc-1267018457-68, seq=2, quorate=1
Feb 24 14:34:17 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:34:17 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:34:17 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:34:17 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:34:17 bob pengine: [2329]: info: find_clone: Internally renamed res_drbd_mysql1:0 on alice.demo to res_drbd_mysql1:1
Feb 24 14:34:17 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:34:17 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:34:17 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:34:17 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:17 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:34:17 bob pengine: [2329]: notice: short_print:      Masters: [ bob.demo ]
Feb 24 14:34:17 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql1:1 ]
Feb 24 14:34:17 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:34:17 bob pengine: [2329]: notice: short_print:      Masters: [ alice.demo ]
Feb 24 14:34:17 bob pengine: [2329]: notice: short_print:      Slaves: [ bob.demo ]
Feb 24 14:34:17 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Started alice.demo
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Started alice.demo
Feb 24 14:34:17 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Stopped 
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:17 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:34:17 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:34:17 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:34:17 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:34:17 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:17 bob pengine: [2329]: WARN: native_color: Resource res_drbd_mysql1:1 cannot run anywhere
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql2
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql2
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql1:0 (Master bob.demo)
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql1:0 (Master bob.demo)
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:34:17 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:34:17 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:34:17 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_fs_mysql1 on bob.demo
Feb 24 14:34:17 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_ip_mysql1 on bob.demo
Feb 24 14:34:17 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_mysql1 on bob.demo
Feb 24 14:34:17 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_ip_mysql2 on alice.demo
Feb 24 14:34:17 bob pengine: [2329]: notice: RecurringOp:  Start recurring monitor (15s) for res_mysql2 on alice.demo
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Start res_fs_mysql1	(bob.demo)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Start res_ip_mysql1	(bob.demo)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Start res_mysql1	(bob.demo)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql1:0	(Master bob.demo)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql1:1	(Stopped)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:0	(Master alice.demo)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:1	(Slave bob.demo)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql2	(Started alice.demo)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql2	(Started alice.demo)
Feb 24 14:34:17 bob pengine: [2329]: notice: LogActions: Start res_mysql2	(alice.demo)
Feb 24 14:34:17 bob crmd: [2219]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb 24 14:34:17 bob pengine: [2329]: WARN: process_pe_message: Transition 6: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-97.bz2
Feb 24 14:34:17 bob crmd: [2219]: info: unpack_graph: Unpacked transition 6: 13 actions in 13 synapses
Feb 24 14:34:17 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:34:17 bob crmd: [2219]: info: do_te_invoke: Processing graph 6 (ref=pe_calc-dc-1267018457-68) derived from /var/lib/pengine/pe-warn-97.bz2
Feb 24 14:34:17 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 40 fired and confirmed
Feb 24 14:34:17 bob crmd: [2219]: info: te_rsc_command: Initiating action 34: start res_fs_mysql1_start_0 on bob.demo (local)
Feb 24 14:34:17 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=34:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_mysql1_start_0 )
Feb 24 14:34:17 bob lrmd: [2216]: info: rsc:res_fs_mysql1:27: start
Feb 24 14:34:17 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 110 fired and confirmed
Feb 24 14:34:17 bob crmd: [2219]: info: te_rsc_command: Initiating action 107: monitor res_ip_mysql2_monitor_15000 on alice.demo
Feb 24 14:34:17 bob crmd: [2219]: info: te_rsc_command: Initiating action 108: start res_mysql2_start_0 on alice.demo
Feb 24 14:34:18 alice lrmd: [2265]: info: rsc:res_ip_mysql2:26: monitor
Feb 24 14:34:18 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=107:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_mysql2_monitor_15000 )
Feb 24 14:34:18 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=108:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_mysql2_start_0 )
Feb 24 14:34:18 alice lrmd: [2265]: info: rsc:res_mysql2:27: start
Feb 24 14:34:18 alice crmd: [2268]: info: process_lrm_event: LRM operation res_ip_mysql2_monitor_15000 (call=26, rc=0, cib-update=35, confirmed=false) ok
Feb 24 14:34:19 bob crmd: [2219]: info: match_graph_event: Action res_ip_mysql2_monitor_15000 (107) confirmed on alice.demo (rc=0)
Feb 24 14:34:20 bob lrmd: [2216]: info: RA output: (res_fs_mysql1:start:stderr) logd is not running
Feb 24 14:34:20 bob lrmd: [2216]: info: RA output: (res_fs_mysql1:start:stderr) 2010/02/24_14:34:20 INFO: Running start for /dev/drbd/by-res/mysql1 on /var/lib/mysql1 
Feb 24 14:34:20 bob kernel: kjournald starting.  Commit interval 5 seconds
Feb 24 14:34:20 bob kernel: EXT3 FS on drbd1, internal journal
Feb 24 14:34:20 bob kernel: EXT3-fs: recovery complete.
Feb 24 14:34:20 bob kernel: EXT3-fs: mounted filesystem with ordered data mode.
Feb 24 14:34:21 bob crmd: [2219]: info: process_lrm_event: LRM operation res_fs_mysql1_start_0 (call=27, rc=0, cib-update=58, confirmed=true) ok
Feb 24 14:34:21 bob crmd: [2219]: info: match_graph_event: Action res_fs_mysql1_start_0 (34) confirmed on bob.demo (rc=0)
Feb 24 14:34:21 bob crmd: [2219]: info: te_rsc_command: Initiating action 35: monitor res_fs_mysql1_monitor_15000 on bob.demo (local)
Feb 24 14:34:21 bob lrmd: [2216]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 740 ms (> 100 ms) before being called (GSource: 0x94de4d0)
Feb 24 14:34:21 bob lrmd: [2216]: info: G_SIG_dispatch: started at 429420353 should have started at 429420279
Feb 24 14:34:21 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=35:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_fs_mysql1_monitor_15000 )
Feb 24 14:34:21 bob lrmd: [2216]: info: rsc:res_fs_mysql1:28: monitor
Feb 24 14:34:21 bob crmd: [2219]: info: te_rsc_command: Initiating action 36: start res_ip_mysql1_start_0 on bob.demo (local)
Feb 24 14:34:21 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=36:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_mysql1_start_0 )
Feb 24 14:34:22 bob lrmd: [2216]: info: rsc:res_ip_mysql1:29: start
Feb 24 14:34:22 bob lrmd: [2216]: info: RA output: (res_ip_mysql1:start:stderr) logd is not running
Feb 24 14:34:22 bob crmd: [2219]: info: process_lrm_event: LRM operation res_fs_mysql1_monitor_15000 (call=28, rc=0, cib-update=59, confirmed=false) ok
Feb 24 14:34:22 bob crmd: [2219]: info: match_graph_event: Action res_fs_mysql1_monitor_15000 (35) confirmed on bob.demo (rc=0)
Feb 24 14:34:23 bob lrmd: [2216]: info: RA output: (res_ip_mysql1:start:stderr) 2010/02/24_14:34:23 INFO: ip -f inet addr add 192.168.122.109/24 brd 192.168.122.255 dev eth0 
Feb 24 14:34:24 bob avahi-daemon[2237]: Registering new address record for 192.168.122.109 on eth0.
Feb 24 14:34:24 bob lrmd: [2216]: info: RA output: (res_ip_mysql1:start:stderr) logd is not running
Feb 24 14:34:24 bob lrmd: [2216]: info: RA output: (res_ip_mysql1:start:stderr) 2010/02/24_14:34:24 INFO: ip link set eth0 up 
Feb 24 14:34:24 bob lrmd: [2216]: info: RA output: (res_ip_mysql1:start:stderr) logd is not running
Feb 24 14:34:24 bob lrmd: [2216]: info: RA output: (res_ip_mysql1:start:stderr) 2010/02/24_14:34:24 INFO: /usr/lib/heartbeat/send_arp -i 200 -r 5 -p /var/run/heartbeat/rsctmp/send_arp/send_arp-192.168.122.109 eth0 192.168.122.109 auto not_used not_used 
Feb 24 14:34:24 bob crmd: [2219]: info: process_lrm_event: LRM operation res_ip_mysql1_start_0 (call=29, rc=0, cib-update=60, confirmed=true) ok
Feb 24 14:34:24 bob crmd: [2219]: info: match_graph_event: Action res_ip_mysql1_start_0 (36) confirmed on bob.demo (rc=0)
Feb 24 14:34:24 bob crmd: [2219]: info: te_rsc_command: Initiating action 37: monitor res_ip_mysql1_monitor_15000 on bob.demo (local)
Feb 24 14:34:24 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=37:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_ip_mysql1_monitor_15000 )
Feb 24 14:34:24 bob lrmd: [2216]: info: rsc:res_ip_mysql1:30: monitor
Feb 24 14:34:24 bob crmd: [2219]: info: te_rsc_command: Initiating action 38: start res_mysql1_start_0 on bob.demo (local)
Feb 24 14:34:24 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=38:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_mysql1_start_0 )
Feb 24 14:34:24 bob lrmd: [2216]: info: rsc:res_mysql1:31: start
Feb 24 14:34:24 bob crmd: [2219]: info: process_lrm_event: LRM operation res_ip_mysql1_monitor_15000 (call=30, rc=0, cib-update=61, confirmed=false) ok
Feb 24 14:34:24 bob crmd: [2219]: info: match_graph_event: Action res_ip_mysql1_monitor_15000 (37) confirmed on bob.demo (rc=0)
Feb 24 14:34:25 alice mysql[3139]: [3256]: INFO: MySQL started
Feb 24 14:34:26 alice crmd: [2268]: info: process_lrm_event: LRM operation res_mysql2_start_0 (call=27, rc=0, cib-update=36, confirmed=true) ok
Feb 24 14:34:26 alice lrmd: [2265]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 180 ms (> 100 ms) before being called (GSource: 0x81486a8)
Feb 24 14:34:26 alice lrmd: [2265]: info: G_SIG_dispatch: started at 429420993 should have started at 429420975
Feb 24 14:34:26 alice lrmd: [2265]: info: rsc:res_mysql2:28: monitor
Feb 24 14:34:26 alice crmd: [2268]: info: do_lrm_rsc_op: Performing key=109:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_mysql2_monitor_15000 )
Feb 24 14:34:26 alice crmd: [2268]: info: process_lrm_event: LRM operation res_mysql2_monitor_15000 (call=28, rc=0, cib-update=37, confirmed=false) ok
Feb 24 14:34:26 bob crmd: [2219]: info: match_graph_event: Action res_mysql2_start_0 (108) confirmed on alice.demo (rc=0)
Feb 24 14:34:26 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 111 fired and confirmed
Feb 24 14:34:26 bob crmd: [2219]: info: te_rsc_command: Initiating action 109: monitor res_mysql2_monitor_15000 on alice.demo
Feb 24 14:34:28 bob crmd: [2219]: info: match_graph_event: Action res_mysql2_monitor_15000 (109) confirmed on alice.demo (rc=0)
Feb 24 14:34:29 bob lrmd: [2216]: info: RA output: (res_mysql1:start:stderr) logd is not running
Feb 24 14:34:29 bob lrmd: [2216]: info: RA output: (res_mysql1:start:stderr) 2010/02/24_14:34:29 INFO: MySQL started 
Feb 24 14:34:29 bob crmd: [2219]: info: process_lrm_event: LRM operation res_mysql1_start_0 (call=31, rc=0, cib-update=62, confirmed=true) ok
Feb 24 14:34:29 bob crmd: [2219]: info: match_graph_event: Action res_mysql1_start_0 (38) confirmed on bob.demo (rc=0)
Feb 24 14:34:29 bob crmd: [2219]: info: te_pseudo_action: Pseudo action 41 fired and confirmed
Feb 24 14:34:29 bob crmd: [2219]: info: te_rsc_command: Initiating action 39: monitor res_mysql1_monitor_15000 on bob.demo (local)
Feb 24 14:34:29 bob crmd: [2219]: info: do_lrm_rsc_op: Performing key=39:6:0:e72e2598-a6a9-4509-b4c6-0a6c558e1e02 op=res_mysql1_monitor_15000 )
Feb 24 14:34:29 bob lrmd: [2216]: info: rsc:res_mysql1:32: monitor
Feb 24 14:34:29 bob crmd: [2219]: info: process_lrm_event: LRM operation res_mysql1_monitor_15000 (call=32, rc=0, cib-update=63, confirmed=false) ok
Feb 24 14:34:29 bob crmd: [2219]: info: match_graph_event: Action res_mysql1_monitor_15000 (39) confirmed on bob.demo (rc=0)
Feb 24 14:34:29 bob crmd: [2219]: info: run_graph: ====================================================
Feb 24 14:34:29 bob crmd: [2219]: notice: run_graph: Transition 6 (Complete=13, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-warn-97.bz2): Complete
Feb 24 14:34:29 bob crmd: [2219]: info: te_graph_trigger: Transition 6 is now complete
Feb 24 14:34:29 bob crmd: [2219]: info: notify_crmd: Transition 6 status: done - <null>
Feb 24 14:34:29 bob crmd: [2219]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb 24 14:34:29 bob crmd: [2219]: info: do_state_transition: Starting PEngine Recheck Timer
Feb 24 14:34:33 alice crm_shadow: [3336]: info: Invoked: crm_shadow 
Feb 24 14:34:33 alice cibadmin: [3337]: info: Invoked: cibadmin -Ql 
Feb 24 14:40:12 alice crm_shadow: [5041]: info: Invoked: crm_shadow 
Feb 24 14:40:12 alice cibadmin: [5042]: info: Invoked: cibadmin -Ql 
Feb 24 14:40:36 alice crm_shadow: [5220]: info: Invoked: crm_shadow 
Feb 24 14:40:36 alice cibadmin: [5221]: info: Invoked: cibadmin -Ql -o resources 
Feb 24 14:40:37 alice crm_resource: [5222]: info: Invoked: crm_resource --meta -r ms_drbd_mysql2 -p target-role -v Master 
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="88" num_updates="71" >
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -   <configuration >
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -     <resources >
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -       <master id="ms_drbd_mysql2" >
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -         <meta_attributes id="ms_drbd_mysql2-meta_attributes" >
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -           <nvpair value="Started" id="ms_drbd_mysql2-meta_attributes-target-role" />
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -         </meta_attributes>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -       </master>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -     </resources>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: -   </configuration>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: - </cib>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="89" num_updates="1" >
Feb 24 14:40:37 bob crmd: [2219]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +   <configuration >
Feb 24 14:40:37 bob crmd: [2219]: info: need_abort: Aborting on change to admin_epoch
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +     <resources >
Feb 24 14:40:37 bob crmd: [2219]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +       <master id="ms_drbd_mysql2" >
Feb 24 14:40:37 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +         <meta_attributes id="ms_drbd_mysql2-meta_attributes" >
Feb 24 14:40:37 bob crmd: [2219]: info: do_pe_invoke: Query 64: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +           <nvpair value="Master" id="ms_drbd_mysql2-meta_attributes-target-role" />
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +         </meta_attributes>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +       </master>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +     </resources>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: +   </configuration>
Feb 24 14:40:37 bob cib: [2215]: info: log_data_element: cib:diff: + </cib>
Feb 24 14:40:37 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_modify for section resources (origin=alice.demo/crm_resource/4, version=0.89.1): ok (rc=0)
Feb 24 14:40:37 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=64, ref=pe_calc-dc-1267018837-78, seq=2, quorate=1
Feb 24 14:40:37 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:40:37 bob cib: [5207]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-97.raw
Feb 24 14:40:37 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:40:37 bob cib: [5207]: info: write_cib_contents: Wrote version 0.89.0 of the CIB to disk (digest: 1a7769965388a255d24e0f565cd3f1b9)
Feb 24 14:40:37 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:40:37 bob cib: [5207]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.QpvMSD (digest: /var/lib/heartbeat/crm/cib.dbYhQ5)
Feb 24 14:40:37 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:40:37 bob pengine: [2329]: info: find_clone: Internally renamed res_drbd_mysql1:0 on alice.demo to res_drbd_mysql1:1
Feb 24 14:40:38 alice cib: [5223]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-94.raw
Feb 24 14:40:38 alice cib: [5223]: info: write_cib_contents: Wrote version 0.89.0 of the CIB to disk (digest: 2b7fc08a793df24044c21bf96eba368c)
Feb 24 14:40:38 alice cib: [5223]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.uVubmo (digest: /var/lib/heartbeat/crm/cib.GX0jnY)
Feb 24 14:40:38 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:40:38 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:40:38 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:40:38 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Started bob.demo
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Started bob.demo
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Started bob.demo
Feb 24 14:40:38 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:40:38 bob pengine: [2329]: notice: short_print:      Masters: [ bob.demo ]
Feb 24 14:40:38 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql1:1 ]
Feb 24 14:40:38 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:40:38 bob pengine: [2329]: notice: short_print:      Masters: [ alice.demo ]
Feb 24 14:40:38 bob pengine: [2329]: notice: short_print:      Slaves: [ bob.demo ]
Feb 24 14:40:38 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Started alice.demo
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Started alice.demo
Feb 24 14:40:38 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Started alice.demo
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:40:38 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:40:38 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:40:38 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:40:38 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:40:38 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:40:38 bob pengine: [2329]: WARN: native_color: Resource res_drbd_mysql1:1 cannot run anywhere
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql1:0 (Master bob.demo)
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 1 instances of a possible 1 to master
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql1:0 (Master bob.demo)
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 1 instances of a possible 1 to master
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:40:38 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:40:38 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql1	(Started bob.demo)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql1	(Started bob.demo)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql1	(Started bob.demo)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql1:0	(Master bob.demo)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql1:1	(Stopped)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:0	(Master alice.demo)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:1	(Slave bob.demo)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql2	(Started alice.demo)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql2	(Started alice.demo)
Feb 24 14:40:38 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql2	(Started alice.demo)
Feb 24 14:40:38 bob crmd: [2219]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb 24 14:40:38 bob pengine: [2329]: WARN: process_pe_message: Transition 7: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-98.bz2
Feb 24 14:40:38 bob crmd: [2219]: info: unpack_graph: Unpacked transition 7: 0 actions in 0 synapses
Feb 24 14:40:38 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:40:38 bob crmd: [2219]: info: do_te_invoke: Processing graph 7 (ref=pe_calc-dc-1267018837-78) derived from /var/lib/pengine/pe-warn-98.bz2
Feb 24 14:40:38 bob crmd: [2219]: info: run_graph: ====================================================
Feb 24 14:40:38 bob crmd: [2219]: notice: run_graph: Transition 7 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-warn-98.bz2): Complete
Feb 24 14:40:38 bob crmd: [2219]: info: te_graph_trigger: Transition 7 is now complete
Feb 24 14:40:38 bob crmd: [2219]: info: notify_crmd: Transition 7 status: done - <null>
Feb 24 14:40:38 bob crmd: [2219]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb 24 14:40:38 bob crmd: [2219]: info: do_state_transition: Starting PEngine Recheck Timer
Feb 24 14:40:40 alice crm_shadow: [5253]: info: Invoked: crm_shadow 
Feb 24 14:40:40 alice cibadmin: [5254]: info: Invoked: cibadmin -Ql 
Feb 24 14:41:17 alice crm_shadow: [5440]: info: Invoked: crm_shadow 
Feb 24 14:41:20 alice cibadmin: [5478]: info: Invoked: cibadmin -Ql 
Feb 24 14:41:37 alice cibadmin: [5584]: info: Invoked: cibadmin -Ql -o resources 
Feb 24 14:41:46 bob crm_shadow: [5609]: info: Invoked: crm_shadow 
Feb 24 14:41:47 bob cibadmin: [5610]: info: Invoked: cibadmin -Ql 
Feb 24 14:41:48 bob crm_shadow: [5640]: info: Invoked: crm_shadow 
Feb 24 14:41:48 bob cibadmin: [5641]: info: Invoked: cibadmin -Ql 
Feb 24 14:42:14 alice crm_resource: [5741]: info: Invoked: crm_resource --meta -r ms_drbd_mysql2 -d target-role 
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="89" num_updates="1" >
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -   <configuration >
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -     <resources >
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -       <master id="ms_drbd_mysql2" >
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -         <meta_attributes id="ms_drbd_mysql2-meta_attributes" >
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -           <nvpair id="ms_drbd_mysql2-meta_attributes-target-role" name="target-role" value="Master" __crm_diff_marker__="removed:top" />
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -         </meta_attributes>
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -       </master>
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -     </resources>
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: -   </configuration>
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: - </cib>
Feb 24 14:42:15 bob cib: [2215]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="90" num_updates="1" />
Feb 24 14:42:15 bob crmd: [2219]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
Feb 24 14:42:15 bob cib: [2215]: info: cib_process_request: Operation complete: op cib_delete for section resources (origin=alice.demo/crm_resource/4, version=0.90.1): ok (rc=0)
Feb 24 14:42:15 bob crmd: [2219]: info: need_abort: Aborting on change to admin_epoch
Feb 24 14:42:15 bob crmd: [2219]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Feb 24 14:42:15 bob crmd: [2219]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 24 14:42:15 bob crmd: [2219]: info: do_pe_invoke: Query 65: Requesting the current CIB: S_POLICY_ENGINE
Feb 24 14:42:15 bob crmd: [2219]: info: do_pe_invoke_callback: Invoking the PE: query=65, ref=pe_calc-dc-1267018935-79, seq=2, quorate=1
Feb 24 14:42:15 bob pengine: [2329]: notice: unpack_config: On loss of CCM Quorum: Ignore
Feb 24 14:42:15 bob pengine: [2329]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb 24 14:42:15 bob pengine: [2329]: info: determine_online_status: Node bob.demo is online
Feb 24 14:42:15 bob pengine: [2329]: info: determine_online_status: Node alice.demo is online
Feb 24 14:42:15 bob cib: [5783]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-98.raw
Feb 24 14:42:15 bob pengine: [2329]: info: find_clone: Internally renamed res_drbd_mysql1:0 on alice.demo to res_drbd_mysql1:1
Feb 24 14:42:15 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_nfsexport
Feb 24 14:42:15 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_nfsexport:0 res_drbd_nfsexport:1 ]
Feb 24 14:42:15 bob pengine: [2329]: notice: group_print:  Resource Group: rg_nfs
Feb 24 14:42:15 bob cib: [5783]: info: write_cib_contents: Wrote version 0.90.0 of the CIB to disk (digest: 9ac2302d9c1b0280534257918ab1f040)
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_fs_nfsexport	(ocf::heartbeat:Filesystem):	Stopped 
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_ip_nfs	(ocf::heartbeat:IPaddr2):	Stopped 
Feb 24 14:42:15 bob cib: [5783]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.JWe461 (digest: /var/lib/heartbeat/crm/cib.rNB6Ht)
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_nfs	(lsb:nfs):	Stopped 
Feb 24 14:42:15 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql1
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_fs_mysql1	(ocf::heartbeat:Filesystem):	Started bob.demo
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_ip_mysql1	(ocf::heartbeat:IPaddr2):	Started bob.demo
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_mysql1	(ocf::heartbeat:mysql):	Started bob.demo
Feb 24 14:42:15 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql1
Feb 24 14:42:15 bob pengine: [2329]: notice: short_print:      Masters: [ bob.demo ]
Feb 24 14:42:15 bob pengine: [2329]: notice: short_print:      Stopped: [ res_drbd_mysql1:1 ]
Feb 24 14:42:15 bob pengine: [2329]: notice: clone_print:  Master/Slave Set: ms_drbd_mysql2
Feb 24 14:42:15 bob pengine: [2329]: notice: short_print:      Masters: [ alice.demo ]
Feb 24 14:42:15 bob pengine: [2329]: notice: short_print:      Slaves: [ bob.demo ]
Feb 24 14:42:15 bob pengine: [2329]: notice: group_print:  Resource Group: rg_mysql2
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_fs_mysql2	(ocf::heartbeat:Filesystem):	Started alice.demo
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_ip_mysql2	(ocf::heartbeat:IPaddr2):	Started alice.demo
Feb 24 14:42:15 bob pengine: [2329]: notice: native_print:      res_mysql2	(ocf::heartbeat:mysql):	Started alice.demo
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:42:15 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:0 cannot run anywhere
Feb 24 14:42:15 bob pengine: [2329]: WARN: native_color: Resource res_drbd_nfsexport:1 cannot run anywhere
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_fs_nfsexport
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: ms_drbd_nfsexport: Promoted 0 instances of a possible 1 to master
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_fs_nfsexport: Rolling back scores from res_ip_nfs
Feb 24 14:42:15 bob pengine: [2329]: WARN: native_color: Resource res_fs_nfsexport cannot run anywhere
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_ip_nfs: Rolling back scores from res_nfs
Feb 24 14:42:15 bob pengine: [2329]: WARN: native_color: Resource res_ip_nfs cannot run anywhere
Feb 24 14:42:15 bob pengine: [2329]: WARN: native_color: Resource res_nfs cannot run anywhere
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from ms_drbd_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:0: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_drbd_mysql2:1: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from ms_drbd_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_fs_mysql2
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:42:15 bob pengine: [2329]: WARN: native_color: Resource res_drbd_mysql1:1 cannot run anywhere
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from ms_drbd_mysql2
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql2
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql2
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_fs_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: ms_drbd_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql1:0 (Master bob.demo)
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 1 instances of a possible 1 to master
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql1: Rolling back scores from res_ip_mysql1
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql1:0 (Master bob.demo)
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql1: Promoted 1 instances of a possible 1 to master
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: Promoting res_drbd_mysql2:0 (Master alice.demo)
Feb 24 14:42:15 bob pengine: [2329]: info: master_color: ms_drbd_mysql2: Promoted 1 instances of a possible 1 to master
Feb 24 14:42:15 bob pengine: [2329]: info: native_merge_weights: res_fs_mysql2: Rolling back scores from res_ip_mysql2
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:0	(Stopped)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_nfsexport:1	(Stopped)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_nfsexport	(Stopped)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_nfs	(Stopped)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_nfs	(Stopped)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql1	(Started bob.demo)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql1	(Started bob.demo)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql1	(Started bob.demo)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql1:0	(Master bob.demo)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql1:1	(Stopped)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:0	(Master alice.demo)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_drbd_mysql2:1	(Slave bob.demo)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_fs_mysql2	(Started alice.demo)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_ip_mysql2	(Started alice.demo)
Feb 24 14:42:15 bob pengine: [2329]: notice: LogActions: Leave resource res_mysql2	(Started alice.demo)
Feb 24 14:42:15 bob crmd: [2219]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb 24 14:42:15 bob pengine: [2329]: WARN: process_pe_message: Transition 8: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-99.bz2
Feb 24 14:42:15 bob crmd: [2219]: info: unpack_graph: Unpacked transition 8: 0 actions in 0 synapses
Feb 24 14:42:15 bob pengine: [2329]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 24 14:42:15 bob crmd: [2219]: info: do_te_invoke: Processing graph 8 (ref=pe_calc-dc-1267018935-79) derived from /var/lib/pengine/pe-warn-99.bz2
Feb 24 14:42:15 bob crmd: [2219]: info: run_graph: ====================================================
Feb 24 14:42:15 bob crmd: [2219]: notice: run_graph: Transition 8 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-warn-99.bz2): Complete
Feb 24 14:42:15 bob crmd: [2219]: info: te_graph_trigger: Transition 8 is now complete
Feb 24 14:42:15 bob crmd: [2219]: info: notify_crmd: Transition 8 status: done - <null>
Feb 24 14:42:15 bob crmd: [2219]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb 24 14:42:15 bob crmd: [2219]: info: do_state_transition: Starting PEngine Recheck Timer
Feb 24 14:42:16 alice cib: [5742]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-95.raw
Feb 24 14:42:16 alice cib: [5742]: info: write_cib_contents: Wrote version 0.90.0 of the CIB to disk (digest: 925ef089f1837aa5f9d72a2d17e82ccb)
Feb 24 14:42:16 alice cib: [5742]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.VWzwKZ (digest: /var/lib/heartbeat/crm/cib.YjtjMz)
Feb 24 14:42:18 bob crm_shadow: [5821]: info: Invoked: crm_shadow 
Feb 24 14:42:18 bob cibadmin: [5822]: info: Invoked: cibadmin -Ql 
Feb 24 14:42:39 alice cib: [2264]: info: cib_stats: Processed 170 operations (882.00us average, 0% utilization) in the last 10min
Feb 24 14:42:40 bob cib: [2215]: info: cib_stats: Processed 151 operations (11589.00us average, 0% utilization) in the last 10min
Feb 24 14:44:58 alice root: Mark:HB_REPORT:1267019097
Feb 24 14:45:00 alice cibadmin: [6801]: info: Invoked: cibadmin -Ql 
Feb 24 14:45:01 alice ccm: [2263]: info: client (pid=6805) removed from ccm
Feb 24 14:45:02 alice crm_shadow: [6840]: info: Invoked: crm_shadow 
Feb 24 14:45:02 alice cibadmin: [6841]: info: Invoked: cibadmin -Ql 
Feb 24 14:45:28 alice root: Mark:HB_REPORT:1267019127
Feb 24 14:45:29 alice cibadmin: [8434]: info: Invoked: cibadmin -Ql 
Feb 24 14:45:30 alice ccm: [2263]: info: client (pid=8438) removed from ccm
Feb 24 14:45:32 alice crm_shadow: [8473]: info: Invoked: crm_shadow 
Feb 24 14:45:32 alice cibadmin: [8474]: info: Invoked: cibadmin -Ql 
Feb 24 14:45:53 alice root: Mark:HB_REPORT:1267019149
Feb 24 14:45:55 bob logger: Mark:HB_REPORT:1267019149
