Mar 24 11:19:28 ha-test1 kernel: [59804.806980] ocfs2: Unmounting device (147,0) on (node 1533248)
Mar 24 11:19:28 ha-test1 kernel: [59804.813010] block drbd0: role( Primary -> Secondary ) 
Mar 24 11:19:30 ha-test1 kernel: [59806.113415] block drbd0: peer( Primary -> Unknown ) conn( Connected -> Disconnecting ) pdsk( UpToDate -> DUnknown ) 
Mar 24 11:19:30 ha-test1 kernel: [59806.122486] block drbd0: asender terminated
Mar 24 11:19:30 ha-test1 kernel: [59806.122846] block drbd0: Terminating drbd0_asender
Mar 24 11:19:30 ha-test1 kernel: [59806.123430] block drbd0: Connection closed
Mar 24 11:19:30 ha-test1 kernel: [59806.123932] block drbd0: conn( Disconnecting -> StandAlone ) 
Mar 24 11:19:30 ha-test1 kernel: [59806.124497] block drbd0: receiver terminated
Mar 24 11:19:30 ha-test1 kernel: [59806.124877] block drbd0: Terminating drbd0_receiver
Mar 24 11:19:30 ha-test1 kernel: [59806.125279] block drbd0: disk( UpToDate -> Diskless ) 
Mar 24 11:19:30 ha-test1 kernel: [59806.125741] block drbd0: drbd_bm_resize called with capacity == 0
Mar 24 11:19:30 ha-test1 kernel: [59806.126176] block drbd0: worker terminated
Mar 24 11:19:30 ha-test1 kernel: [59806.126518] block drbd0: Terminating drbd0_worker
Mar 24 11:19:38 ha-test1 kernel: [59814.583887] block drbd0: Starting worker thread (from cqueue [1927])
Mar 24 11:19:38 ha-test1 kernel: [59814.585719] block drbd0: disk( Diskless -> Attaching ) 
Mar 24 11:19:38 ha-test1 kernel: [59814.586957] block drbd0: Found 4 transactions (8 active extents) in activity log.
Mar 24 11:19:38 ha-test1 kernel: [59814.587563] block drbd0: Method to ensure write ordering: barrier
Mar 24 11:19:38 ha-test1 kernel: [59814.587935] block drbd0: max_segment_size ( = BIO size ) = 32768
Mar 24 11:19:38 ha-test1 kernel: [59814.588326] block drbd0: drbd_bm_resize called with capacity == 4191120
Mar 24 11:19:38 ha-test1 kernel: [59814.588738] block drbd0: resync bitmap: bits=523890 words=16372
Mar 24 11:19:38 ha-test1 kernel: [59814.589100] block drbd0: size = 2046 MB (2095560 KB)
Mar 24 11:19:38 ha-test1 kernel: [59814.589860] block drbd0: recounting of set bits took additional 0 jiffies
Mar 24 11:19:38 ha-test1 kernel: [59814.590247] block drbd0: 0 KB (0 bits) marked out-of-sync by on disk bit-map.
Mar 24 11:19:38 ha-test1 kernel: [59814.590646] block drbd0: disk( Attaching -> Outdated ) 
Mar 24 11:19:38 ha-test1 kernel: [59814.612230] block drbd0: conn( StandAlone -> Unconnected ) 
Mar 24 11:19:38 ha-test1 kernel: [59814.612604] block drbd0: Starting receiver thread (from drbd0_worker [14813])
Mar 24 11:19:38 ha-test1 kernel: [59814.614133] block drbd0: receiver (re)started
Mar 24 11:19:38 ha-test1 kernel: [59814.614456] block drbd0: conn( Unconnected -> WFConnection ) 
Mar 24 11:19:38 ha-test1 kernel: [59814.716595] block drbd0: Handshake successful: Agreed network protocol version 91
Mar 24 11:19:38 ha-test1 kernel: [59814.718080] block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC
Mar 24 11:19:38 ha-test1 kernel: [59814.718518] block drbd0: conn( WFConnection -> WFReportParams ) 
Mar 24 11:19:38 ha-test1 kernel: [59814.718938] block drbd0: Starting asender thread (from drbd0_receiver [14826])
Mar 24 11:19:38 ha-test1 kernel: [59814.722535] block drbd0: data-integrity-alg: <not-used>
Mar 24 11:19:38 ha-test1 kernel: [59814.722992] block drbd0: drbd_sync_handshake:
Mar 24 11:19:38 ha-test1 kernel: [59814.723349] block drbd0: self 8CA088A82954801C:0000000000000000:6E203A7A8A969218:0A34D9A38DA29C7B bits:0 flags:0
Mar 24 11:19:38 ha-test1 kernel: [59814.724142] block drbd0: peer 776D8B76649F91D5:8CA088A82954801D:6E203A7A8A969219:0A34D9A38DA29C7B bits:0 flags:0
Mar 24 11:19:38 ha-test1 kernel: [59814.724909] block drbd0: uuid_compare()=-1 by rule 50
Mar 24 11:19:38 ha-test1 kernel: [59814.725294] block drbd0: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate ) 
Mar 24 11:19:38 ha-test1 kernel: [59814.747741] block drbd0: conn( WFBitMapT -> WFSyncUUID ) 
Mar 24 11:19:38 ha-test1 kernel: [59814.750638] block drbd0: helper command: /sbin/drbdadm before-resync-target minor-0
Mar 24 11:19:38 ha-test1 kernel: [59814.759710] block drbd0: helper command: /sbin/drbdadm before-resync-target minor-0 exit code 0 (0x0)
Mar 24 11:19:38 ha-test1 kernel: [59814.760384] block drbd0: conn( WFSyncUUID -> SyncTarget ) disk( Outdated -> Inconsistent ) 
Mar 24 11:19:38 ha-test1 kernel: [59814.761008] block drbd0: Began resync as SyncTarget (will sync 0 KB [0 bits set]).
Mar 24 11:19:39 ha-test1 kernel: [59815.302057] block drbd0: role( Secondary -> Primary ) 
Mar 24 11:19:39 ha-test1 kernel: [59815.312028] block drbd0: Resync done (total 1 sec; paused 0 sec; 0 K/sec)
Mar 24 11:19:39 ha-test1 kernel: [59815.312450] block drbd0: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate ) 
Mar 24 11:19:39 ha-test1 kernel: [59815.313087] block drbd0: helper command: /sbin/drbdadm after-resync-target minor-0
Mar 24 11:19:39 ha-test1 kernel: [59815.349346] block drbd0: helper command: /sbin/drbdadm after-resync-target minor-0 exit code 0 (0x0)
Mar 24 11:19:40 ha-test1 kernel: [59816.373291] OCFS2 Node Manager 1.5.0
Mar 24 11:19:40 ha-test1 kernel: [59816.394533] OCFS2 1.5.0
Mar 24 11:19:43 ha-test1 kernel: [59818.917143] ocfs2: Mounting device (147,0) on (node 1533248, slot 1) with ordered data mode.
Mar 24 11:19:55 ha-test1 kernel: [59831.374625] block drbd0: conn( Connected -> VerifyT ) 
Mar 24 11:19:55 ha-test1 kernel: [59831.379419] block drbd0: Online Verify start sector: 0
Mar 24 11:21:47 ha-test1 kernel: [59943.200693] block drbd0: Online verify  done (total 111 sec; paused 0 sec; 18876 K/sec)
Mar 24 11:21:47 ha-test1 kernel: [59943.201410] block drbd0: conn( VerifyT -> Connected ) 
Mar 24 11:22:42 ha-test1 kernel: [59998.440462] block drbd0: peer( Primary -> Unknown ) conn( Connected -> NetworkFailure ) pdsk( UpToDate -> DUnknown ) 
Mar 24 11:22:42 ha-test1 kernel: [59998.441265] block drbd0: asender terminated
Mar 24 11:22:42 ha-test1 kernel: [59998.441627] block drbd0: Terminating drbd0_asender
Mar 24 11:22:42 ha-test1 kernel: [59998.442674] block drbd0: Creating new current UUID
Mar 24 11:22:42 ha-test1 kernel: [59998.449130] block drbd0: Connection closed
Mar 24 11:22:42 ha-test1 kernel: [59998.449500] block drbd0: conn( NetworkFailure -> Unconnected ) 
Mar 24 11:22:42 ha-test1 kernel: [59998.449914] block drbd0: receiver terminated
Mar 24 11:22:42 ha-test1 kernel: [59998.450308] block drbd0: Restarting drbd0_receiver
Mar 24 11:22:42 ha-test1 kernel: [59998.450676] block drbd0: receiver (re)started
Mar 24 11:22:42 ha-test1 kernel: [59998.451048] block drbd0: conn( Unconnected -> WFConnection ) 
Mar 24 11:23:12 ha-test1 kernel: [60028.440753] (15584,0):ocfs2_replay_journal:1607 Recovering node 1550025994 from slot 0 on device (147,0)
Mar 24 11:23:12 ha-test1 kernel: [60028.676548] (15584,0):ocfs2_begin_quota_recovery:376 Beginning quota recovery in slot 0
Mar 24 11:23:12 ha-test1 kernel: [60028.695311] (15086,0):ocfs2_finish_quota_recovery:569 Finishing quota recovery in slot 0
Mar 24 11:23:16 ha-test1 kernel: [60032.116131] block drbd0: Handshake successful: Agreed network protocol version 91
Mar 24 11:23:16 ha-test1 kernel: [60032.120928] block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC
Mar 24 11:23:16 ha-test1 kernel: [60032.121362] block drbd0: conn( WFConnection -> WFReportParams ) 
Mar 24 11:23:16 ha-test1 kernel: [60032.121769] block drbd0: Starting asender thread (from drbd0_receiver [14826])
Mar 24 11:23:16 ha-test1 kernel: [60032.127840] block drbd0: data-integrity-alg: <not-used>
Mar 24 11:23:16 ha-test1 kernel: [60032.128345] block drbd0: drbd_sync_handshake:
Mar 24 11:23:16 ha-test1 kernel: [60032.128707] block drbd0: self D41D475489593F4F:776D8B76649F91D5:BC3E3DC51473A94B:8CA088A82954801D bits:5 flags:0
Mar 24 11:23:16 ha-test1 kernel: [60032.129425] block drbd0: peer 106264E0B3E5B750:776D8B76649F91D5:BC3E3DC51473A94A:8CA088A82954801D bits:2048 flags:2
Mar 24 11:23:16 ha-test1 kernel: [60032.130170] block drbd0: uuid_compare()=100 by rule 90
Mar 24 11:23:16 ha-test1 kernel: [60032.130527] block drbd0: Split-Brain detected, 1 primaries, automatically solved. Sync from this node
Mar 24 11:23:16 ha-test1 kernel: [60032.131244] block drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpToDate ) 
Mar 24 11:23:16 ha-test1 kernel: [60032.204357] block drbd0: conn( WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent ) 
Mar 24 11:23:16 ha-test1 kernel: [60032.205074] block drbd0: Began resync as SyncSource (will sync 8200 KB [2050 bits set]).
Mar 24 11:23:16 ha-test1 kernel: [60032.527309] block drbd0: Resync done (total 1 sec; paused 0 sec; 8200 K/sec)
Mar 24 11:23:16 ha-test1 kernel: [60032.527832] block drbd0: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate ) 
Mar 24 11:23:17 ha-test1 kernel: [60033.844143] block drbd0: peer( Secondary -> Primary ) 
Mar 24 11:56:18 ha-test1 kernel: [62013.903177] ocfs2: Unmounting device (147,0) on (node 1533248)
Mar 24 11:56:19 ha-test1 kernel: [62014.989000] block drbd0: role( Primary -> Secondary ) 
Mar 24 11:56:20 ha-test1 kernel: [62016.282133] block drbd0: peer( Primary -> Unknown ) conn( Connected -> Disconnecting ) pdsk( UpToDate -> DUnknown ) 
Mar 24 11:56:20 ha-test1 kernel: [62016.289157] block drbd0: asender terminated
Mar 24 11:56:20 ha-test1 kernel: [62016.289521] block drbd0: Terminating drbd0_asender
Mar 24 11:56:20 ha-test1 kernel: [62016.290482] block drbd0: Connection closed
Mar 24 11:56:20 ha-test1 kernel: [62016.290844] block drbd0: conn( Disconnecting -> StandAlone ) 
Mar 24 11:56:20 ha-test1 kernel: [62016.291285] block drbd0: receiver terminated
Mar 24 11:56:20 ha-test1 kernel: [62016.291646] block drbd0: Terminating drbd0_receiver
Mar 24 11:56:20 ha-test1 kernel: [62016.292056] block drbd0: disk( UpToDate -> Diskless ) 
Mar 24 11:56:20 ha-test1 kernel: [62016.292487] block drbd0: drbd_bm_resize called with capacity == 0
Mar 24 11:56:20 ha-test1 kernel: [62016.292906] block drbd0: worker terminated
Mar 24 11:56:20 ha-test1 kernel: [62016.293333] block drbd0: Terminating drbd0_worker
Mar 24 11:56:26 ha-test1 kernel: [62021.980656] block drbd0: Starting worker thread (from cqueue [1927])
Mar 24 11:56:26 ha-test1 kernel: [62021.982430] block drbd0: disk( Diskless -> Attaching ) 
Mar 24 11:56:26 ha-test1 kernel: [62021.983966] block drbd0: Found 4 transactions (8 active extents) in activity log.
Mar 24 11:56:26 ha-test1 kernel: [62021.984696] block drbd0: Method to ensure write ordering: barrier
Mar 24 11:56:26 ha-test1 kernel: [62021.985072] block drbd0: max_segment_size ( = BIO size ) = 32768
Mar 24 11:56:26 ha-test1 kernel: [62021.985445] block drbd0: drbd_bm_resize called with capacity == 4191120
Mar 24 11:56:26 ha-test1 kernel: [62021.985881] block drbd0: resync bitmap: bits=523890 words=16372
Mar 24 11:56:26 ha-test1 kernel: [62021.986238] block drbd0: size = 2046 MB (2095560 KB)
Mar 24 11:56:26 ha-test1 kernel: [62021.987060] block drbd0: recounting of set bits took additional 0 jiffies
Mar 24 11:56:26 ha-test1 kernel: [62021.987449] block drbd0: 0 KB (0 bits) marked out-of-sync by on disk bit-map.
Mar 24 11:56:26 ha-test1 kernel: [62021.987844] block drbd0: disk( Attaching -> Outdated ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.009493] block drbd0: conn( StandAlone -> Unconnected ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.009864] block drbd0: Starting receiver thread (from drbd0_worker [23009])
Mar 24 11:56:26 ha-test1 kernel: [62022.014151] block drbd0: receiver (re)started
Mar 24 11:56:26 ha-test1 kernel: [62022.014480] block drbd0: conn( Unconnected -> WFConnection ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.115800] block drbd0: Handshake successful: Agreed network protocol version 91
Mar 24 11:56:26 ha-test1 kernel: [62022.117756] block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC
Mar 24 11:56:26 ha-test1 kernel: [62022.118211] block drbd0: conn( WFConnection -> WFReportParams ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.118778] block drbd0: Starting asender thread (from drbd0_receiver [23022])
Mar 24 11:56:26 ha-test1 kernel: [62022.122579] block drbd0: data-integrity-alg: <not-used>
Mar 24 11:56:26 ha-test1 kernel: [62022.123041] block drbd0: drbd_sync_handshake:
Mar 24 11:56:26 ha-test1 kernel: [62022.123557] block drbd0: self D41D475489593F4E:0000000000000000:F9B8C513BFB4AF90:776D8B76649F91D5 bits:0 flags:0
Mar 24 11:56:26 ha-test1 kernel: [62022.124319] block drbd0: peer 1A51B003CDCCE2AD:D41D475489593F4F:F9B8C513BFB4AF90:776D8B76649F91D5 bits:0 flags:0
Mar 24 11:56:26 ha-test1 kernel: [62022.125224] block drbd0: uuid_compare()=-1 by rule 50
Mar 24 11:56:26 ha-test1 kernel: [62022.125610] block drbd0: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.145899] block drbd0: conn( WFBitMapT -> WFSyncUUID ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.147250] block drbd0: helper command: /sbin/drbdadm before-resync-target minor-0
Mar 24 11:56:26 ha-test1 kernel: [62022.155825] block drbd0: helper command: /sbin/drbdadm before-resync-target minor-0 exit code 0 (0x0)
Mar 24 11:56:26 ha-test1 kernel: [62022.156497] block drbd0: conn( WFSyncUUID -> SyncTarget ) disk( Outdated -> Inconsistent ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.157129] block drbd0: Began resync as SyncTarget (will sync 0 KB [0 bits set]).
Mar 24 11:56:26 ha-test1 kernel: [62022.700965] block drbd0: role( Secondary -> Primary ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.708085] block drbd0: Resync done (total 1 sec; paused 0 sec; 0 K/sec)
Mar 24 11:56:26 ha-test1 kernel: [62022.708475] block drbd0: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate ) 
Mar 24 11:56:26 ha-test1 kernel: [62022.709104] block drbd0: helper command: /sbin/drbdadm after-resync-target minor-0
Mar 24 11:56:26 ha-test1 kernel: [62022.745084] block drbd0: helper command: /sbin/drbdadm after-resync-target minor-0 exit code 0 (0x0)
Mar 24 11:56:27 ha-test1 kernel: [62023.764841] OCFS2 Node Manager 1.5.0
Mar 24 11:56:27 ha-test1 kernel: [62023.786233] OCFS2 1.5.0
Mar 24 11:56:30 ha-test1 kernel: [62026.185485] ocfs2: Mounting device (147,0) on (node 1533248, slot 1) with ordered data mode.
Mar 24 11:56:50 ha-test1 kernel: [62046.676505] block drbd0: peer( Primary -> Unknown ) conn( Connected -> NetworkFailure ) pdsk( UpToDate -> DUnknown ) 
Mar 24 11:56:50 ha-test1 kernel: [62046.677209] block drbd0: asender terminated
Mar 24 11:56:50 ha-test1 kernel: [62046.677533] block drbd0: Terminating drbd0_asender
Mar 24 11:56:50 ha-test1 kernel: [62046.678432] block drbd0: Creating new current UUID
Mar 24 11:56:50 ha-test1 kernel: [62046.680636] block drbd0: Connection closed
Mar 24 11:56:50 ha-test1 kernel: [62046.680952] block drbd0: conn( NetworkFailure -> Unconnected ) 
Mar 24 11:56:50 ha-test1 kernel: [62046.681315] block drbd0: receiver terminated
Mar 24 11:56:50 ha-test1 kernel: [62046.681631] block drbd0: Restarting drbd0_receiver
Mar 24 11:56:50 ha-test1 kernel: [62046.681959] block drbd0: receiver (re)started
Mar 24 11:56:50 ha-test1 kernel: [62046.682281] block drbd0: conn( Unconnected -> WFConnection ) 
Mar 24 11:57:19 ha-test1 kernel: [62075.612305] (23448,0):ocfs2_replay_journal:1607 Recovering node 1550025994 from slot 0 on device (147,0)
Mar 24 11:57:20 ha-test1 kernel: [62075.910531] (23448,0):ocfs2_begin_quota_recovery:376 Beginning quota recovery in slot 0
Mar 24 11:57:20 ha-test1 kernel: [62075.920400] (23282,0):ocfs2_finish_quota_recovery:569 Finishing quota recovery in slot 0
Mar 24 11:57:20 ha-test1 kernel: [62076.852104] block drbd0: Handshake successful: Agreed network protocol version 91
Mar 24 11:57:20 ha-test1 kernel: [62076.853576] block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC
Mar 24 11:57:20 ha-test1 kernel: [62076.854071] block drbd0: conn( WFConnection -> WFReportParams ) 
Mar 24 11:57:20 ha-test1 kernel: [62076.854482] block drbd0: Starting asender thread (from drbd0_receiver [23022])
Mar 24 11:57:20 ha-test1 kernel: [62076.859315] block drbd0: data-integrity-alg: <not-used>
Mar 24 11:57:20 ha-test1 kernel: [62076.859866] block drbd0: drbd_sync_handshake:
Mar 24 11:57:20 ha-test1 kernel: [62076.860248] block drbd0: self ACD67DF7CB806053:1A51B003CDCCE2AD:B6B4527D6911F313:D41D475489593F4F bits:5 flags:0
Mar 24 11:57:20 ha-test1 kernel: [62076.860998] block drbd0: peer 1A51B003CDCCE2AC:0000000000000000:B6B4527D6911F312:D41D475489593F4F bits:2048 flags:2
Mar 24 11:57:20 ha-test1 kernel: [62076.861777] block drbd0: uuid_compare()=1 by rule 70
Mar 24 11:57:20 ha-test1 kernel: [62076.862164] block drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpToDate ) 
Mar 24 11:57:20 ha-test1 kernel: [62076.891161] block drbd0: conn( WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent ) 
Mar 24 11:57:20 ha-test1 kernel: [62076.891791] block drbd0: Began resync as SyncSource (will sync 8200 KB [2050 bits set]).
Mar 24 11:57:21 ha-test1 kernel: [62077.241803] block drbd0: Resync done (total 1 sec; paused 0 sec; 8200 K/sec)
Mar 24 11:57:21 ha-test1 kernel: [62077.242268] block drbd0: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate ) 
Mar 24 11:57:23 ha-test1 kernel: [62079.766936] block drbd0: peer( Secondary -> Primary ) 
